00000100:00100000:2.0F:1789896013.683902:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896013.683960:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0F:1789896013.683970:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015942400 00000100:00100000:1.0:1789896013.683987:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015942400 00000100:00100000:0.0F:1789896013.683989:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015942272 00000100:00100000:0.0:1789896013.684000:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015942272 00000100:00100000:2.0:1789896013.684005:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896013.684034:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015942528 00000100:00100000:2.0:1789896013.684039:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015942528 00000100:00100000:0.0:1789896013.684065:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1786 00000100:00100000:1.0:1789896013.684066:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 466 00000100:00100000:0.0:1789896013.684077:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:2404:x1876838015942272:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789896013.684083:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 467 00000100:00100000:1.0:1789896013.684084:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2404:x1876838015942400:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789896013.684094:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2404:x1876838015942528:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789896013.684152:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:2404:x1876838015942272:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 77us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896013.684158:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2404:x1876838015942528:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 61us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896013.684159:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2404:x1876838015942400:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 78us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896013.684168:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1786 00000100:00100000:2.0:1789896013.684177:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 467 00000100:00100000:1.0:1789896013.684184:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 466 00000100:00080000:2.0:1789896013.684260:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789896013.684265:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789896013.804309:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896014.252418:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003482112:0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.252469:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003481984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789896014.252496:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896014.252507:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003482240:0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.252522:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896014.252549:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003482624:0@lo:400:kworker.0 00000100:00100000:0.0:1789896014.252557:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896014.252563:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003482368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789896014.252585:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896014.252589:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876838003482752:0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.252610:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896014.252621:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003483136:0@lo:400:kworker.0 00000100:00100000:0.0:1789896014.252634:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896014.252640:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003482880:0@lo:400:kworker.0 00000100:00100000:2.0:1789896014.252661:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896014.252666:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876838003483264:0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.252684:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896014.252689:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876838003483648:0@lo:400:kworker.0 00000100:00100000:0.0:1789896014.252702:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896014.252716:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876838003483392:0@lo:400:kworker.0 00000100:00100000:0.0:1789896014.252729:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876838003483776:0@lo:400:kworker.0 00000100:00100000:2.0:1789896014.252733:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896014.252760:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896014.252770:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003482240 00000100:00100000:2.0:1789896014.252775:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1789896014.252778:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003482240 00000100:00100000:2.0:1789896014.252786:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003481856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789896014.252819:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896014.252825:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003482112 00000100:00100000:0.0:1789896014.252829:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003482880 00000100:00100000:1.0:1789896014.252832:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003482112 00000100:00100000:0.0:1789896014.252835:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003482880 00000100:00100000:2.0:1789896014.252843:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003482496:0@lo:400:kworker.0 00000100:00100000:0.0:1789896014.252866:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789896014.252873:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896014.252879:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003482240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.252886:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1787 00000100:00100000:2.0:1789896014.252895:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003483008:0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.252899:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3618:x1876838003482112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896014.252946:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896014.252961:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003482240:12345-0@lo:400:kworker.0 Request processed in 84us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896014.252962:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3618:x1876838003482112:12345-0@lo:400:kworker.0 Request processed in 67us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896014.252972:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876838003483520:0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.252980:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1787 00000100:00100000:0.0:1789896014.252981:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789896014.253007:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896014.253008:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789896014.253020:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003481984 00000100:00100000:0.0:1789896014.253022:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa72d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003482880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.253026:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003481984 00000100:00100000:2.0:1789896014.253049:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003482112:0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.253075:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003482368 00000100:00100000:0.0:1789896014.253079:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa72d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003482880:12345-0@lo:400:kworker.0 Request processed in 60us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896014.253080:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003482368 00000100:00100000:2.0:1789896014.253089:0:191519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003482624 00000100:00100000:2.0:1789896014.253096:0:191519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003482624 00000100:00100000:0.0:1789896014.253101:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789896014.253110:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003481856 00000100:00100000:1.0:1789896014.253115:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003481856 00000100:00100000:1.0:1789896014.253135:0:190238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789896014.253139:0:191519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003483136 00000100:00100000:0.0:1789896014.253144:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789896014.253145:0:190238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa72d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876838003481984:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789896014.253146:0:191519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003483136 00000100:00100000:0.0:1789896014.253160:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa72d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003482368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789896014.253169:0:190238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896014.253170:0:191519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003482496 00000100:00100000:2.0:1789896014.253175:0:191519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003482496 00002000:00000024:0.0:1789896014.253178:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896014.253194:0:191519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003483008 00000100:00100000:2.0:1789896014.253222:0:191519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003483008 00000100:00100000:1.0:1789896014.253239:0:190238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa72d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876838003481984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896014.253251:0:190238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789896014.253252:0:191519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789896014.253255:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa72d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876838003482368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896014.253263:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789896014.253267:0:191519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003482624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.253275:0:190238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789896014.253286:0:190238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876838003481856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789896014.253307:0:190238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789896014.253311:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896014.253329:0:191519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003482624:12345-0@lo:400:kworker.0 Request processed in 65us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896014.253338:0:191519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1789896014.253344:0:190238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1876838003481856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896014.253351:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003482240:0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.253353:0:190238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789896014.253357:0:191519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789896014.253368:0:191519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003483136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896014.253384:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003481984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789896014.253389:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003482752 00000100:00100000:1.0:1789896014.253394:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003482752 00000100:00100000:0.0:1789896014.253406:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003482368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789896014.253410:0:191519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003483136:12345-0@lo:400:kworker.0 Request processed in 42us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896014.253418:0:191519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789896014.253420:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003483264 00000100:00100000:1.0:1789896014.253424:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003483264 00000100:00100000:0.0:1789896014.253426:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003482880:0@lo:400:kworker.0 00000100:00100000:2.0:1789896014.253433:0:191519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789896014.253442:0:191519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003482496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.253444:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003483648 00000100:00100000:1.0:1789896014.253447:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003483648 00000100:00100000:1.0:1789896014.253467:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003483392 00000100:00100000:1.0:1789896014.253469:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003483392 00000100:00100000:2.0:1789896014.253474:0:191519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003482496:12345-0@lo:400:kworker.0 Request processed in 36us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896014.253485:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003483520 00000100:00100000:2.0:1789896014.253489:0:191519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789896014.253489:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003483520 00000100:00100000:2.0:1789896014.253507:0:191519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789896014.253509:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003483776 00000100:00100000:1.0:1789896014.253512:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003483776 00000100:00100000:2.0:1789896014.253516:0:191519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003483008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896014.253534:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1789896014.253543:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1789896014.253544:0:191519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003483008:12345-0@lo:400:kworker.0 Request processed in 28us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896014.253547:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3615:x1876838003482752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.253558:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+11:3615:x1876838003483264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896014.253560:0:191519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789896014.253595:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00000100:00100000:0.0:1789896014.253601:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3615:x1876838003482752:12345-0@lo:400:kworker.0 Request processed in 57us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896014.253609:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876838003483648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.253614:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+11:3615:x1876838003483264:12345-0@lo:400:kworker.0 Request processed in 56us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896014.253614:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00000100:00100000:1.0:1789896014.253627:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1789896014.253639:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:1.0:1789896014.253648:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789896014.253654:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876838003483648:12345-0@lo:400:kworker.0 Request processed in 48us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896014.253654:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa72d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+8:3616:x1876838003483392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896014.253662:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876838003483520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896014.253670:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:2.0:1789896014.253691:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:2.0:1789896014.253700:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876838003483776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896014.253717:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa72d4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+8:3616:x1876838003483392:12345-0@lo:400:kworker.0 Request processed in 69us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896014.253719:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876838003483520:12345-0@lo:400:kworker.0 Request processed in 61us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896014.253733:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:2.0:1789896014.253738:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876838003483776:12345-0@lo:400:kworker.0 Request processed in 39us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896014.253739:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789896014.253750:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00080000:2.0:1789896014.253779:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789896014.253784:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789896014.253785:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876838003482752:0@lo:400:kworker.0 00000100:00080000:2.0:1789896014.253789:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789896014.253793:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789896014.253793:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876838003483392:0@lo:400:kworker.0 00000100:00100000:0.0:1789896014.253822:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876838003483264:0@lo:400:kworker.0 00000100:00100000:2.0:1789896014.253836:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003481856:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789896014.253844:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a94681f100 x1876838003483776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789896014.253854:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003482496:0@lo:400:kworker.0 00000100:00100000:0.0:1789896014.253859:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876838003483776:0@lo:400:kworker.0 00000100:00100000:2.0:1789896014.253874:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003483008:0@lo:400:kworker.0 00010000:00080000:2.0:1789896014.253888:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a94ffbd180 x1876838003483520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789896014.253904:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876838003483520:0@lo:400:kworker.0 00000100:00100000:2.0:1789896014.253916:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003483136:0@lo:400:kworker.0 00000100:00100000:2.0:1789896014.253925:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876838003483648:0@lo:400:kworker.0 00000100:00100000:2.0:1789896014.253932:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003482624:0@lo:400:kworker.0 00000020:00000080:0.0:1789896014.766175:0:212705:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc2f6dd420 20000000:00000080:0.0:1789896014.766187:0:212705:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91aa7f16ac00 uarg=0000000000000000 00000040:00100000:0.0:1789896014.766638:0:212705:0:(llog.c:1072:llog_reverse_process()) index 143 : idx 137 00000040:00100000:0.0:1789896014.766645:0:212705:0:(llog.c:1072:llog_reverse_process()) index 135 : idx 93 20000000:01000000:0.0:1789896014.766647:0:212705:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 132 cmd:0xce021 lustre.qpool1 lustre-OST0000_UUID 20000000:01000000:0.0:1789896014.766659:0:212705:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:0.0:1789896014.766868:0:212706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 131 marker 142 1->4: lustre-clilov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:0.0:1789896014.766916:0:212706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 133 marker 142 2->4: lustre-clilov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:0.0:1789896014.766937:0:212706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 144 count 141 00000040:00080000:2.0:1789896014.767065:0:212705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].144, 224 off34344 20000000:01000000:2.0:1789896014.767090:0:212705:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:2.0:1789896014.767109:0:212705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].145, 128 off34472 00000040:00080000:2.0:1789896014.767127:0:212705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].146, 224 off34696 20000000:01000000:2.0:1789896014.767140:0:212705:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:0.0:1789896014.767386:0:212707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 154 marker 143 1->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:0.0:1789896014.767410:0:212707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 156 marker 143 2->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:0.0:1789896014.767426:0:212707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 166 count 163 00000040:00080000:2.0:1789896014.767499:0:212705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].166, 224 off38488 20000000:01000000:2.0:1789896014.767507:0:212705:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:2.0:1789896014.767515:0:212705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].167, 136 off38624 00000040:00080000:2.0:1789896014.767522:0:212705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].168, 224 off38848 20000000:01000000:2.0:1789896014.767528:0:212705:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:0.0:1789896014.767684:0:212708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 154 marker 144 1->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:0.0:1789896014.767699:0:212708:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 156 marker 144 2->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:0.0:1789896014.767707:0:212708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 166 count 163 00000040:00080000:2.0:1789896014.767770:0:212705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].166, 224 off38488 20000000:01000000:2.0:1789896014.767777:0:212705:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:2.0:1789896014.767785:0:212705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].167, 136 off38624 00000040:00080000:2.0:1789896014.767793:0:212705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].168, 224 off38848 10000000:01000000:2.0:1789896014.767800:0:212705:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789896014.767814:0:212705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767828:0:212705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a1e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1e74 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767833:0:212705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1e89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1e82 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767842:0:212705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1e97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1e90 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767846:0:212705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a1ea5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1e9e expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767850:0:212705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1eb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1eac expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767853:0:212705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a1ec1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1eba expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767856:0:212705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a1ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1ec8 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767860:0:212705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a1edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1ed6 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767864:0:212705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1ee4 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767869:0:212705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f560 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767874:0:212705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a1ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f567 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767882:0:212705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767938:0:212705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a1ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f567 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.767953:0:212705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a1ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f567 expref: 9 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896014.767968:0:212705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003483904:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789896014.768045:0:212705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f560 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.768051:0:212705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1ef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f560 expref: 9 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896014.768058:0:212705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003484032:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789896014.768086:0:212705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1ee4 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.768094:0:212705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1eeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1ee4 expref: 23 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896014.768103:0:212705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003484160:0@lo:104: 00000100:00100000:2.0:1789896014.768138:0:212705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896014.768175:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003484160 00010000:00010000:2.0:1789896014.768176:0:212705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a1edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1ed6 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.768183:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003484160 00010000:00010000:2.0:1789896014.768189:0:212705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a1edd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1ed6 expref: 23 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.768303:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1789896014.768316:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212705:x1876838003484160:12345-0@lo:104: 00010000:00010000:0.0:1789896014.768331:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a1ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1eeb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.768404:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789896014.768410:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212705:x1876838003484160:12345-0@lo:104: Request processed in 99us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896014.768417:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00010000:00010000:1.0:1789896014.768426:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789896014.768433:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a1ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1eeb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.768441:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7400 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896014.768444:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a1ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1eeb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.768451:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a1ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1eeb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896014.768456:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a1ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1eeb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896014.768460:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896014.768490:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a1ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1eeb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.768495:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896014.768498:0:212705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003484288:0@lo:104: 00010000:00010000:1.0:1789896014.768517:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a1ee4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1eeb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.768522:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003484416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896014.768536:0:212705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896014.768541:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a1ee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1eeb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.768551:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896014.768554:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896014.768554:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896014.768559:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896014.768585:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003484288 00000100:00100000:1.0:1789896014.768589:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003484288 00010000:00010000:2.0:1789896014.768595:0:212705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a1ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1ec8 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.768597:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003484416 00000100:00100000:0.0:1789896014.768603:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003484416 00010000:00010000:2.0:1789896014.768609:0:212705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a1ecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1ec8 expref: 24 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896014.768610:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00010000:00010000:0.0:1789896014.768622:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1eeb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1ee4 expref: 24 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896014.768623:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212705:x1876838003484288:12345-0@lo:104: 00000100:00100000:2.0:1789896014.768624:0:212705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003484544:0@lo:104: 00010000:00010000:1.0:1789896014.768637:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a1ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1edd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.768659:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1789896014.768667:0:212705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896014.768672:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3616:x1876838003484416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896014.768683:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789896014.768685:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896014.768690:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212705:x1876838003484288:12345-0@lo:104: Request processed in 71us (158us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896014.768693:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1eeb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1ee4 expref: 24 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896014.768699:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0F:1789896014.768700:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003484544 00010000:00010000:2.0:1789896014.768706:0:212705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a1ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1eba expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.768713:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003484544 00010000:00010000:1.0:1789896014.768718:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789896014.768720:0:212705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a1ec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1eba expref: 24 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.768723:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a1ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1edd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.768739:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5aa00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896014.768743:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a1ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1edd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.768744:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1eeb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1ee4 expref: 24 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896014.768745:0:212705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003484672:0@lo:104: 00000100:00100000:3.0:1789896014.768752:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00010000:00010000:1.0:1789896014.768761:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a1ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1edd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.768766:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212705:x1876838003484544:12345-0@lo:104: 00010000:00010000:3.0:1789896014.768776:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a1ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1ecf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896014.768778:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a1ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1edd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.768778:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896014.768788:0:212705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789896014.768798:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896014.768824:0:212705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1eb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1eac expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.768829:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a1ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1edd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.768830:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3616:x1876838003484416:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (275us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896014.768843:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789896014.768846:0:212705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1eb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1eac expref: 24 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.768850:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896014.768850:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1789896014.768857:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212705:x1876838003484544:12345-0@lo:104: Request processed in 92us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896014.768868:0:212705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003484800:0@lo:104: 00000100:00100000:3.0:1789896014.768872:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00010000:00010000:1.0:1789896014.768875:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a1ed6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1edd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.768884:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a1ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1edd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.768889:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003484416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896014.768892:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003484672 00000100:00100000:3.0:1789896014.768898:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003484672 00000100:00100000:2.0:1789896014.768900:0:212705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896014.768901:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789896014.768906:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a1ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1ecf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.768913:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7800 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896014.768916:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a1ec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1ecf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.768923:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a1ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1ecf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.768927:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003484800 10000000:00010000:1.0:1789896014.768928:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a1ec8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1ecf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.768933:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003484800 00010000:00010000:2.0:1789896014.768935:0:212705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a1ea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1e9e expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896014.768939:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789896014.768955:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00010000:00010000:2.0:1789896014.768962:0:212705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a1ea5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1e9e expref: 23 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.768965:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a1ec8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1ecf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.768968:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212705:x1876838003484672:12345-0@lo:104: 00010000:00010000:1.0:1789896014.768984:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896014.768989:0:212705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003485056:0@lo:104: 00010000:00010000:3.0:1789896014.768990:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a1eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1ec1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.769000:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a1ec8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1ecf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.769008:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a1ec8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1ecf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.769019:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896014.769021:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896014.769025:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896014.769035:0:212705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896014.769038:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003484928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896014.769129:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789896014.769138:0:212705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1e97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1e90 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.769139:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212705:x1876838003484672:12345-0@lo:104: Request processed in 173us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896014.769143:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896014.769160:0:212705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1e97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1e90 expref: 23 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.769166:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1789896014.769173:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789896014.769178:0:212705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003485312:0@lo:104: 00000100:00100000:1.0:1789896014.769185:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003485184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896014.769194:0:200085:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789896014.769246:0:200085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896014.769256:0:212705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1e82 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.769266:0:212705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1e89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1e82 expref: 23 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896014.769275:0:212705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003485440:0@lo:104: 00000100:00100000:3.0:1789896014.769332:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003485056 00000100:00100000:3.0:1789896014.769336:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003485056 00000100:00100000:2.0:1789896014.769342:0:212705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896014.769355:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896014.769359:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003485312 00010000:00010000:2.0:1789896014.769370:0:212705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a1e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1e74 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.769382:0:212705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a1e7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1e74 expref: 23 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.769382:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896014.769394:0:212705:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003485568:0@lo:104: 00000100:00100000:1.0:1789896014.769398:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003484928 00000100:00100000:1.0:1789896014.769402:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003484928 00010000:00010000:1.0:1789896014.769419:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a1edd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1ed6 expref: 24 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.769427:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003485312 00000100:00100000:2.0:1789896014.769429:0:212705:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896014.769443:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003485184 00000100:00100000:1.0:1789896014.769449:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003485184 00000100:00100000:0.0:1789896014.769454:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896014.769455:0:212705:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fbc00 going to sleep for 11 seconds 00010000:00010000:1.0:1789896014.769468:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a1ecf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1ec8 expref: 25 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896014.769472:0:212705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003483904:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789896014.769487:0:212705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003484032:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789896014.769492:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003485440 00010000:00010000:2.0:1789896014.769499:0:212705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1eeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1ee4 expref: 25 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.769501:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003485440 00000100:00100000:0.0:1789896014.769503:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015942656 00000100:00100000:1.0:1789896014.769504:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015942784 00000100:00100000:0.0:1789896014.769509:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015942656 00000100:00100000:1.0:1789896014.769510:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015942784 00000100:00100000:2.0:1789896014.769514:0:212705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003484160:0@lo:104: 00000100:00100000:3.0:1789896014.769524:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003485568 00000100:00100000:2.0:1789896014.769527:0:212705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003484288:0@lo:104: 00000100:00100000:3.0:1789896014.769528:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003485568 00010000:00010000:0.0:1789896014.769531:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a1ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f567 expref: 11 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.769532:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1ef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f560 expref: 11 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896014.769540:0:212705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003484544:0@lo:104: 00000100:00100000:3.0:1789896014.769558:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789896014.769558:0:212705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003484672:0@lo:104: 00000100:00100000:0.0:1789896014.769559:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1789896014.769570:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1789896014.769574:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+7:212705:x1876838003484800:12345-0@lo:104: 00000100:00100000:0.0:1789896014.769575:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d546680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3617:x1876838003484928:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896014.769583:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a9514bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3617:x1876838003485184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896014.769585:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a1eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1eb3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.769586:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896014.769591:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789896014.769591:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896014.769594:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a1edd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1ed6 expref: 24 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.769598:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a1eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1ec1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.769600:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a1ecf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1ec8 expref: 24 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.769607:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a1edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1ed6 expref: 24 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.769618:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b600 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896014.769623:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a1eba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1ec1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896014.769628:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789896014.769628:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a1ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1ec8 expref: 24 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.769635:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a1eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1ec1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.769638:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+7:212705:x1876838003484800:12345-0@lo:104: Request processed in 68us (740us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896014.769650:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a1edd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1ed6 expref: 24 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.769651:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 10000000:00010000:2.0:1789896014.769651:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a1eba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1ec1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.769654:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a1ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1ec8 expref: 24 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.769667:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 10000000:01000000:2.0:1789896014.769675:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789896014.769680:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94c9e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+6:212705:x1876838003485056:12345-0@lo:104: 00010000:00010000:1.0:1789896014.769683:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896014.769684:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896014.769687:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a1e9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1ea5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.769694:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a1eba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1ec1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.769699:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896014.769720:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a1eba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1ec1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.769725:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a1eba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1ec1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896014.769731:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a9514bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3617:x1876838003485184:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896014.769733:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d546680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3617:x1876838003484928:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (590us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896014.769737:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789896014.769739:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789896014.769745:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a1eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1eb3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896014.769746:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1789896014.769749:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94c9e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+6:212705:x1876838003485056:12345-0@lo:104: Request processed in 69us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896014.769756:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00010000:00010000:2.0:1789896014.769762:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6c00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896014.769766:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a1eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1eb3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.769768:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789896014.769770:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 419 00010000:00010000:2.0:1789896014.769779:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a1eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1eb3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896014.769785:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a1eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1eb3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896014.769785:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015942656:12345-192.168.202.44@tcp:103:ldlm_bl.0 10000000:01000000:2.0:1789896014.769796:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896014.769798:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896014.769804:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a1ef9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f567 expref: 11 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.769811:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a1eac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1eb3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.769816:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a1ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f567 expref: 11 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.769819:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 420 00000100:00100000:3.0:1789896014.769820:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00010000:00010000:2.0:1789896014.769827:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789896014.769835:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:212705:x1876838003485312:12345-0@lo:104: 00010000:00010000:2.0:1789896014.769837:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a1eac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1eb3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.769837:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015942784:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789896014.769838:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a1ef9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f567 expref: 11 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896014.769850:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a1e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1e97 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.769852:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896014.769859:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6c00/0x412fd4b3617a1eac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1eb3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.769861:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1ef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f560 expref: 11 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.769887:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f560 expref: 10 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.769895:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789896014.769901:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a1e9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1ea5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.769902:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896014.769907:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789896014.769908:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6800 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896014.769913:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a1e9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1ea5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.769917:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1ef2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f560 expref: 10 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.769919:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:212705:x1876838003485312:12345-0@lo:104: Request processed in 86us (669us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896014.769927:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a1e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1ea5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896014.769938:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f6720b-db77-464e-82b6-5f314c431303+9:2404:x1876838015942656:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 154us (555us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896014.769940:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:2.0:1789896014.769944:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a1e9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1ea5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.769946:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 10000000:01000000:2.0:1789896014.769954:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896014.769959:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 419 00000100:00100000:0.0:1789896014.769969:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f6720b-db77-464e-82b6-5f314c431303+9:2403:x1876838015942784:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 135us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896014.769970:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00010000:00010000:2.0:1789896014.769971:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a1e9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1ea5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.769984:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212705:x1876838003485440:12345-0@lo:104: 00010000:00010000:2.0:1789896014.769985:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896014.769985:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 420 00010000:00010000:3.0:1789896014.770000:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a1e82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1e89 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770001:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a1e9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1ea5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.770012:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003485824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896014.770017:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a1e9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1ea5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770028:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789896014.770030:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a1e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1e97 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770041:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5be00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896014.770043:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a1e90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1e97 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770048:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a1e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1e97 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896014.770053:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a1e90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1e97 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.770057:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896014.770060:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1789896014.770063:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:2.0:1789896014.770063:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896014.770072:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003485952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896014.770074:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212705:x1876838003485440:12345-0@lo:104: Request processed in 93us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896014.770084:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789896014.770091:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003485696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896014.770093:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a1e90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1e97 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770101:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896014.770109:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a1e90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1e97 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896014.770118:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896014.770126:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a1e90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1e97 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.770127:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00010000:00010000:2.0:1789896014.770145:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789896014.770145:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003485824 00000100:00100000:0.0:1789896014.770150:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003485824 00010000:00010000:2.0:1789896014.770152:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a1e82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1e89 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.770153:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789896014.770159:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003486080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896014.770166:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1eb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1eac expref: 21 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.770168:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212705:x1876838003485568:12345-0@lo:104: 00010000:00010000:2.0:1789896014.770168:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6400 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896014.770176:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a1e82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1e89 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896014.770182:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a1e74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1e7b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896014.770191:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896014.770222:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a1e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1e89 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896014.770227:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a1e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1e89 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896014.770230:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896014.770241:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789896014.770246:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a1e82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1e89 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.770249:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212705:x1876838003485568:12345-0@lo:104: Request processed in 86us (823us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896014.770252:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896014.770259:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a1e82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1e89 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.770262:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00010000:00010000:2.0:1789896014.770269:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a1e82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1e89 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.770271:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003485952 00000100:00100000:0.0:1789896014.770276:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003485952 00010000:00010000:2.0:1789896014.770282:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789896014.770285:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a1e74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1e7b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.770300:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a1ea5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1e9e expref: 22 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896014.770302:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896014.770302:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a400 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896014.770309:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a1e74 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1e7b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770315:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a1e74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1e7b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.770319:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003486080 10000000:00010000:2.0:1789896014.770320:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a1e74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1e7b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.770324:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1789896014.770325:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003486080 10000000:01000000:2.0:1789896014.770333:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896014.770338:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3616:x1876838003485824:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896014.770340:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00010000:00010000:3.0:1789896014.770345:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1e97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1e90 expref: 23 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770349:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a1e74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1e7b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.770352:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896014.770355:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d544e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3618:x1876838003485952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896014.770363:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1eb3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1eac expref: 23 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770366:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896014.770370:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789896014.770373:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00010000:00010000:2.0:1789896014.770374:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a1e74 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1e7b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896014.770377:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a1ea5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1e9e expref: 23 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.770389:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d546a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3618:x1876838003486080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896014.770394:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a1e74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1e7b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.770401:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1eb3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1eac expref: 23 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770407:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896014.770410:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896014.770414:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896014.770418:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a1ea5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1e9e expref: 23 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896014.770420:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896014.770430:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1e97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1e90 expref: 23 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.770436:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896014.770437:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896014.770445:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1e97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1e90 expref: 23 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770445:0:212705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1eb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1eac expref: 23 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896014.770470:0:212705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003484800:0@lo:104: 00010000:00010000:3.0:1789896014.770472:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896014.770478:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3616:x1876838003485824:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (421us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896014.770486:0:212705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a1ea5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1e9e expref: 22 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896014.770490:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d544e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3618:x1876838003485952:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896014.770490:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1789896014.770500:0:212705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003485056:0@lo:104: 00000100:00100000:1.0:1789896014.770505:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1789896014.770512:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d546a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3618:x1876838003486080:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (322us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896014.770513:0:212705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1e97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1e90 expref: 20 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896014.770528:0:212705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003485312:0@lo:104: 00000100:00100000:3.0:1789896014.770532:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1789896014.770539:0:212705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003485440:0@lo:104: 00000100:00100000:1.0:1789896014.770547:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896014.770551:0:212705:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212705:1876838003485568:0@lo:104: 00010000:00010000:3.0:1789896014.770558:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896014.770571:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003485696 00000100:00100000:3.0:1789896014.770575:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003485696 00010000:00010000:3.0:1789896014.770595:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a1ec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1eba expref: 18 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896014.770595:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003485824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896014.770598:0:212705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896014.770624:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003486336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896014.770637:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896014.770640:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1789896014.770650:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003486208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896014.770652:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d544380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3616:x1876838003485696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896014.770664:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896014.770664:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896014.770672:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a1ec1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1eba expref: 18 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896014.770682:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896014.770690:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a1ec1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1eba expref: 18 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.770692:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003486336 00000100:00100000:0.0:1789896014.770698:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003486336 00010000:00010000:3.0:1789896014.770711:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a1ec1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1eba expref: 19 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.770713:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a1e7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1e74 expref: 19 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770723:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896014.770724:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003485184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896014.770735:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896014.770741:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003484928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896014.770745:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003486208 00000100:00100000:0.0:1789896014.770749:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1789896014.770750:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003486208 00000100:00100000:0.0:1789896014.770759:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a9514bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3616:x1876838003486336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896014.770768:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1e89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1e82 expref: 19 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.770768:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896014.770775:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003486080:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896014.770776:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a1e7b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1e74 expref: 19 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.770784:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d544380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3616:x1876838003485696:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896014.770793:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1789896014.770796:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003485952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896014.770798:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a1e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1e74 expref: 19 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.770804:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1789896014.770807:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3615:x1876838003486208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896014.770823:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896014.770825:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a1e7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1e74 expref: 18 pid: 188725 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770830:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1e89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1e82 expref: 18 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896014.770843:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003485696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896014.770851:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1e89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1e82 expref: 17 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.770859:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896014.770867:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1e89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1e82 expref: 17 pid: 188723 timeout: 3987 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770882:0:188717:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.770888:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a9514bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3616:x1876838003486336:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (224us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896014.770894:0:188717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896014.770897:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1789896014.770902:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003486336:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896014.770925:0:188717:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770933:0:188717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770941:0:188717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770948:0:188717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770954:0:188717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9a00 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:2.0:1789896014.770958:0:188717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770965:0:188717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770983:0:188717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.770994:0:212705:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896014.770995:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896014.771002:0:212705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896014.771007:0:212705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1f00 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 212705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896014.771029:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3615:x1876838003486208:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896014.771035:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1789896014.771059:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003486208:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896014.828328:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896015.276415:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003486464:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789896015.276486:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896015.276531:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003486464 00000100:00100000:0.0:1789896015.276540:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003486464 00000100:00100000:0.0:1789896015.276589:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789896015.276599:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003486464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789896015.276633:0:188736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789896015.276682:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003486464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896015.276690:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789896015.276726:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003486464:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789896015.852390:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896016.051726:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896016.051815:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015942912 00000100:00100000:2.0:1789896016.051828:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015942912 00000100:00100000:2.0:1789896016.051895:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1788 00000100:00100000:2.0:1789896016.051918:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015942912:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896016.051937:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896016.051958:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1f07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f56e expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.051987:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f56e expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.051999:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f56e expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.052008:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9000, rc 0) 00000100:00100000:2.0:1789896016.052067:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015942912:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 151us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.052074:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1788 00000100:00100000:1.0:1789896016.052875:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896016.052919:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015943040 00000100:00100000:0.0:1789896016.052926:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015943040 00000100:00100000:0.0:1789896016.052965:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1789 00000100:00100000:0.0:1789896016.052972:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015943040:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.053113:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015943040:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 142us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.053118:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1789 00000100:00100000:0.0:1789896016.053723:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896016.053771:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015943168 00000100:00100000:2.0:1789896016.053775:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015943168 00000100:00100000:2.0:1789896016.053800:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1790 00000100:00100000:2.0:1789896016.053806:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015943168:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.053880:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015943168:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 75us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.053886:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1790 00000100:00100000:1.0:1789896016.054782:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896016.054818:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015943296 00000100:00100000:0.0:1789896016.054822:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015943296 00000100:00100000:0.0:1789896016.054851:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1791 00000100:00100000:0.0:1789896016.054858:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:212607:x1876838015943296:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789896016.054932:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:212607:x1876838015943296:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 75us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.054936:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1791 00000100:00100000:1.0:1789896016.055538:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896016.055583:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015943424 00000100:00100000:2.0:1789896016.055588:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015943424 00000100:00100000:2.0:1789896016.055618:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1792 00000100:00100000:2.0:1789896016.055627:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:212607:x1876838015943424:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896016.055685:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:212607:x1876838015943424:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 60us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.055691:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1792 00000100:00100000:3.0:1789896016.056576:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896016.056614:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015943552 00000100:00100000:0.0:1789896016.056618:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015943552 00000100:00100000:0.0:1789896016.056645:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1793 00000100:00100000:0.0:1789896016.056651:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015943552:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896016.056659:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896016.056674:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1f0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f575 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.056693:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f575 expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.056701:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f575 expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.056709:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b800, rc 0) 00000100:00100000:0.0:1789896016.056730:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015943552:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 80us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.056734:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1793 00000100:00100000:1.0:1789896016.057314:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896016.057352:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015943680 00000100:00100000:2.0:1789896016.057356:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015943680 00000100:00100000:2.0:1789896016.057381:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1794 00000100:00100000:2.0:1789896016.057390:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015943680:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.057441:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015943680:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 53us (128us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789896016.057454:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1794 10000000:01000000:1.0:1789896016.172345:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896016.172353:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 144 10000000:01000000:1.0:1789896016.172359:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896016.172411:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896016.172421:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896016.172431:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896016.172455:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003486592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896016.172535:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896016.172577:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.172591:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003486592 00000100:00100000:0.0:1789896016.172600:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003486592 00000100:00100000:0.0:1789896016.172662:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1795 00000100:00100000:0.0:1789896016.172673:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003486592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896016.172701:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896016.172713:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a1f1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1f15 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.172735:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a1f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1f15 expref: 16 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.172744:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a1f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f15 expref: 16 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.172752:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5ba00, rc 0) 00000100:00100000:0.0:1789896016.172795:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003486592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.172800:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1795 00000100:00100000:1.0:1789896016.172838:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003486592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896016.172855:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f1c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896016.172871:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1f1c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896016.172933:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003486720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896016.172952:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896016.172967:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.173009:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003486720 00000100:00100000:2.0:1789896016.173015:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003486720 00000100:00100000:2.0:1789896016.173053:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796 00000100:00100000:2.0:1789896016.173063:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003486720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.173191:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003486720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896016.173219:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003486720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.173236:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796 00000100:00100000:1.0:1789896016.173245:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003486848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896016.173294:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896016.173310:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.173325:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003486848 00000100:00100000:0.0:1789896016.173329:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003486848 00000100:00100000:0.0:1789896016.173349:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1797 00000100:00100000:0.0:1789896016.173355:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003486848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896016.173457:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003486848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.173459:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003486848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.173469:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1797 00000100:00100000:0.0:1789896016.173754:0:212709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212709:1876838003486976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.173780:0:212709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896016.173796:0:212709:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45455000 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.173823:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003486976 00000100:00100000:2.0:1789896016.173827:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003486976 00000100:00100000:2.0:1789896016.173846:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1798 00000100:00100000:2.0:1789896016.173852:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:212709:x1876838003486976:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896016.173932:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:212709:x1876838003486976:12345-0@lo:502:llog_process_th.0 Request processed in 80us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.173937:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1798 00000100:00100000:0.0:1789896016.173961:0:212709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212709:1876838003486976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.173993:0:212709:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212709:1876838003487104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.174018:0:212709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896016.174034:0:212709:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45455000 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.174055:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003487104 00000100:00100000:2.0:1789896016.174064:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003487104 00000100:00100000:2.0:1789896016.174085:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1799 00000100:00100000:2.0:1789896016.174089:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:212709:x1876838003487104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896016.174141:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:212709:x1876838003487104:12345-0@lo:502:llog_process_th.0 Request processed in 51us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.174146:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1799 00000100:00100000:0.0:1789896016.174167:0:212709:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212709:1876838003487104:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896016.174184:0:212709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000020:01000000:1.0:1789896016.174270:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 144-146 (rc=0) 10000000:01000000:1.0:1789896016.174308:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896016.174316:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f1c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896016.174326:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f1c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896016.174336:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789896016.174337:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:1.0:1789896016.174340:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789896016.174355:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896016.174362:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896016.174376:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896016.174388:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003487232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896016.174413:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896016.174437:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.174460:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003487232 00000100:00100000:2.0:1789896016.174466:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003487232 00000100:00100000:2.0:1789896016.174492:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1800 00000100:00100000:2.0:1789896016.174500:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003487232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896016.174508:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896016.174518:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1f2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1f23 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.174532:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1f23 expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.174540:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f23 expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.174546:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9800, rc 0) 00000100:00100000:2.0:1789896016.174574:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003487232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.174580:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1800 00000100:00100000:1.0:1789896016.174595:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003487232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896016.174608:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f2a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896016.174617:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1f2a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896016.174650:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003487360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896016.174676:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896016.174694:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.174706:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003487360 00000100:00100000:2.0:1789896016.174710:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003487360 00000100:00100000:2.0:1789896016.174726:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801 00000100:00100000:2.0:1789896016.174731:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003487360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.174790:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003487360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 59us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.174796:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801 00000100:00100000:1.0:1789896016.174807:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003487360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896016.174832:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003487488:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896016.174861:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896016.174876:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.174892:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003487488 00000100:00100000:2.0:1789896016.174896:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003487488 00000100:00100000:2.0:1789896016.174911:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802 00000100:00100000:2.0:1789896016.174915:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003487488:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.174967:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003487488:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 51us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.174972:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802 00000100:00100000:1.0:1789896016.174988:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003487488:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789896016.175582:0:212710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:2.0:1789896016.175645:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:2.0:1789896016.175660:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789896016.175665:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f2a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.175673:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f2a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896016.175680:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896016.175682:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 144 10000000:01000000:2.0:1789896016.175684:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896016.175698:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.175705:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.175713:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896016.175732:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003487616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.175756:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.175779:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.175784:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003487616 00000100:00100000:0.0:1789896016.175788:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003487616 00000100:00100000:0.0:1789896016.175809:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1803 00000100:00100000:0.0:1789896016.175814:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003487616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896016.175820:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896016.175827:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a1f38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1f31 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.175840:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a1f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1f31 expref: 18 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.175849:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a1f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f31 expref: 18 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.175855:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b400, rc 0) 00000100:00100000:0.0:1789896016.175886:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003487616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.175893:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1803 00000100:00100000:2.0:1789896016.175918:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003487616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896016.175929:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f38 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.175934:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1f38 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896016.175968:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003487744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.175996:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.176014:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.176030:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003487744 00000100:00100000:0.0:1789896016.176034:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003487744 00000100:00100000:0.0:1789896016.176060:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804 00000100:00100000:0.0:1789896016.176067:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003487744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.176121:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003487744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 56us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.176133:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804 00000100:00100000:2.0:1789896016.176146:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003487744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.176166:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003487872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.176217:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896016.176235:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003487872 00000100:00100000:0.0:1789896016.176238:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003487872 00000100:00100000:2.0:1789896016.176240:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.176259:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805 00000100:00100000:0.0:1789896016.176264:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003487872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.176326:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003487872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.176331:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805 00000100:00100000:2.0:1789896016.176345:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003487872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.176512:0:212711:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212711:1876838003488000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.176539:0:212711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896016.176553:0:212711:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45106f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.176561:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003488000 00000100:00100000:2.0:1789896016.176565:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003488000 00000100:00100000:2.0:1789896016.176584:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806 00000100:00100000:2.0:1789896016.176589:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:212711:x1876838003488000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896016.176645:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:212711:x1876838003488000:12345-0@lo:502:llog_process_th.0 Request processed in 56us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.176654:0:212711:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212711:1876838003488000:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896016.176657:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806 00000100:00100000:0.0:1789896016.176686:0:212711:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212711:1876838003488128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.176711:0:212711:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896016.176724:0:212711:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45106f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.176732:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003488128 00000100:00100000:2.0:1789896016.176736:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003488128 00000100:00100000:2.0:1789896016.176753:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1807 00000100:00100000:2.0:1789896016.176756:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:212711:x1876838003488128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896016.176802:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:212711:x1876838003488128:12345-0@lo:502:llog_process_th.0 Request processed in 44us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.176807:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1807 00000100:00100000:0.0:1789896016.176815:0:212711:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212711:1876838003488128:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896016.176833:0:212711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000020:01000000:2.0:1789896016.176867:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 144-146 (rc=0) 10000000:01000000:2.0:1789896016.176886:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896016.176890:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f38 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.176896:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f38 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896016.176900:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789896016.176901:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:2.0:1789896016.176903:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789896016.176912:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.176916:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.176921:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896016.176929:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003488256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.176950:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.176962:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fe540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.176973:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003488256 00000100:00100000:0.0:1789896016.176977:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003488256 00000100:00100000:0.0:1789896016.176996:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808 00000100:00100000:0.0:1789896016.177002:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003488256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896016.177007:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896016.177012:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a1f46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1f3f expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.177029:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a1f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1f3f expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.177035:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a1f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f3f expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.177042:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5ae00, rc 0) 00000100:00100000:0.0:1789896016.177077:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003488256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.177084:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808 00000100:00100000:2.0:1789896016.177086:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003488256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896016.177097:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f46 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.177103:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1f46 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896016.177126:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003488384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.177142:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.177152:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fe540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.177162:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003488384 00000100:00100000:0.0:1789896016.177167:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003488384 00000100:00100000:0.0:1789896016.177192:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809 00000100:00100000:0.0:1789896016.177224:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003488384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.177293:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003488384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.177299:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809 00000100:00100000:2.0:1789896016.177301:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003488384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.177323:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003488512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.177347:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896016.177365:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003488512 00000100:00100000:2.0:1789896016.177369:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fe540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.177369:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003488512 00000100:00100000:0.0:1789896016.177391:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810 00000100:00100000:0.0:1789896016.177395:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003488512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.177447:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003488512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 51us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.177456:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810 00000100:00100000:2.0:1789896016.177462:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003488512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789896016.177959:0:212712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:2.0:1789896016.177995:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:2.0:1789896016.178010:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789896016.178014:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f46 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.178019:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f46 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896016.178024:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896016.178030:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 144 10000000:01000000:2.0:1789896016.178031:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896016.178040:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.178045:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.178049:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896016.178056:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003488640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.178072:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.178082:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fe540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.178092:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003488640 00000100:00100000:0.0:1789896016.178100:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003488640 00000100:00100000:0.0:1789896016.178120:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1811 00000100:00100000:0.0:1789896016.178124:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003488640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896016.178129:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896016.178135:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a1f54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1f4d expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.178144:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a1f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1f4d expref: 20 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.178149:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a1f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f4d expref: 20 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.178153:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a200, rc 0) 00000100:00100000:0.0:1789896016.178176:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003488640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 53us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.178180:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1811 00000100:00100000:2.0:1789896016.178214:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003488640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896016.178225:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f54 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.178231:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1f54 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896016.178254:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003488768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.178271:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896016.178302:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003488768 00000100:00100000:2.0:1789896016.178303:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fe540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.178306:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003488768 00000100:00100000:0.0:1789896016.178328:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:0.0:1789896016.178332:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003488768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.178375:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003488768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 43us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.178381:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00100000:2.0:1789896016.178394:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003488768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.178416:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003488896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.178439:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.178454:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fe540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.178462:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003488896 00000100:00100000:0.0:1789896016.178467:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003488896 00000100:00100000:0.0:1789896016.178490:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:0.0:1789896016.178496:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003488896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.178556:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003488896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.178559:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003488896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.178565:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00100000:0.0:1789896016.178713:0:212713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212713:1876838003489024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.178736:0:212713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896016.178750:0:212713:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5930ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.178752:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003489024 00000100:00100000:2.0:1789896016.178756:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003489024 00000100:00100000:2.0:1789896016.178775:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814 00000100:00100000:2.0:1789896016.178779:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:212713:x1876838003489024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896016.178829:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:212713:x1876838003489024:12345-0@lo:502:llog_process_th.0 Request processed in 49us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.178834:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814 00000100:00100000:0.0:1789896016.178842:0:212713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212713:1876838003489024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.178871:0:212713:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212713:1876838003489152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.178893:0:212713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896016.178906:0:212713:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5930ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.178909:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003489152 00000100:00100000:2.0:1789896016.178913:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003489152 00000100:00100000:2.0:1789896016.178930:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1815 00000100:00100000:2.0:1789896016.178934:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:212713:x1876838003489152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896016.178977:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:212713:x1876838003489152:12345-0@lo:502:llog_process_th.0 Request processed in 43us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.178982:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1815 00000100:00100000:0.0:1789896016.178990:0:212713:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212713:1876838003489152:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896016.179008:0:212713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000020:01000000:2.0:1789896016.179036:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 144-146 (rc=0) 10000000:01000000:2.0:1789896016.179050:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896016.179055:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f54 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.179059:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f54 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896016.179064:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789896016.179066:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 166 10000000:01000000:2.0:1789896016.179067:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789896016.179076:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.179084:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.179089:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896016.179097:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003489280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.179113:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.179124:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5bfe03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.179133:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003489280 00000100:00100000:0.0:1789896016.179137:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003489280 00000100:00100000:0.0:1789896016.179156:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:0.0:1789896016.179160:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003489280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896016.179165:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896016.179171:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a1f62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1f5b expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.179180:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a1f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1f5b expref: 21 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.179185:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a1f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f5b expref: 21 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.179211:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a800, rc 0) 00000100:00100000:0.0:1789896016.179247:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003489280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.179255:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000100:00100000:1.0:1789896016.179264:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003489280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896016.179291:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f62 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896016.179307:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1f62 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896016.179344:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003489408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896016.179368:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896016.179393:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0240 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.179406:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003489408 00000100:00100000:2.0:1789896016.179410:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003489408 00000100:00100000:2.0:1789896016.179426:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:2.0:1789896016.179431:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003489408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.179475:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003489408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 44us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.179481:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00100000:1.0:1789896016.179497:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003489408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896016.179524:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003489536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896016.179557:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896016.179575:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.179586:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003489536 00000100:00100000:0.0:1789896016.179590:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003489536 00000100:00100000:0.0:1789896016.179608:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1818 00000100:00100000:0.0:1789896016.179612:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003489536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.179663:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003489536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 50us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.179668:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818 00000100:00100000:1.0:1789896016.179679:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003489536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896016.179875:0:212714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212714:1876838003489664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896016.179907:0:212714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896016.179928:0:212714:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.179937:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003489664 00000100:00100000:2.0:1789896016.179940:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003489664 00000100:00100000:2.0:1789896016.179955:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1819 00000100:00100000:2.0:1789896016.179960:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:212714:x1876838003489664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896016.180016:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:212714:x1876838003489664:12345-0@lo:502:llog_process_th.0 Request processed in 56us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.180021:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1819 00000100:00100000:1.0:1789896016.180031:0:212714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212714:1876838003489664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896016.180051:0:212714:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896016.180060:0:212714:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896016.180062:0:212714:0:(obd_config.c:1561:class_process_config()) marker 156 (0x1) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:1.0:1789896016.180065:0:212714:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1789896016.180082:0:212714:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from qpool1 00000100:00100000:1.0:1789896016.180094:0:212714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212714:1876838003489792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896016.180117:0:212714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896016.180129:0:212714:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.180146:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003489792 00000100:00100000:0.0:1789896016.180149:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003489792 00000100:00100000:0.0:1789896016.180169:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820 00000100:00100000:0.0:1789896016.180173:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:212714:x1876838003489792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.180294:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:212714:x1876838003489792:12345-0@lo:502:llog_process_th.0 Request processed in 119us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896016.180299:0:212714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212714:1876838003489792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.180300:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820 00000020:01000000:1.0:1789896016.180322:0:212714:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896016.180325:0:212714:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896016.180326:0:212714:0:(obd_config.c:1561:class_process_config()) marker 156 (0x2) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:1.0:1789896016.180329:0:212714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 169 count 166 00000020:01000000:2.0:1789896016.180380:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 166-168 (rc=0) 10000000:01000000:2.0:1789896016.180399:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789896016.180405:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f62 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.180415:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f62 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896016.180420:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896016.180421:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 144 10000000:01000000:2.0:1789896016.180423:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896016.180432:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.180437:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.180442:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896016.180449:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003489920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.180467:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.180483:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7f021c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.180494:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003489920 00000100:00100000:0.0:1789896016.180498:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003489920 00000100:00100000:0.0:1789896016.180518:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821 00000100:00100000:0.0:1789896016.180522:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003489920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896016.180527:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896016.180533:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a1f70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1f69 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.180554:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a1f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1f69 expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.180562:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a1f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f69 expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.180568:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b200, rc 0) 00000100:00100000:0.0:1789896016.180603:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003489920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.180609:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821 00000100:00100000:2.0:1789896016.180621:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003489920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896016.180630:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f70 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.180636:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1f70 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896016.180660:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003490048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.180675:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.180691:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7f021c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.180694:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003490048 00000100:00100000:0.0:1789896016.180698:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003490048 00000100:00100000:0.0:1789896016.180716:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1822 00000100:00100000:0.0:1789896016.180720:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003490048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.180772:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003490048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 50us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.180778:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1822 00000100:00100000:2.0:1789896016.180781:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003490048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.180801:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003490176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.180824:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.180834:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7f021c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.180841:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003490176 00000100:00100000:0.0:1789896016.180845:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003490176 00000100:00100000:0.0:1789896016.180863:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1823 00000100:00100000:0.0:1789896016.180867:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003490176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.180913:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003490176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 45us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.180918:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1823 00000100:00100000:2.0:1789896016.180928:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003490176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.181115:0:212715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212715:1876838003490304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.181145:0:212715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896016.181158:0:212715:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.181165:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003490304 00000100:00100000:2.0:1789896016.181169:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003490304 00000100:00100000:2.0:1789896016.181191:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:2.0:1789896016.181222:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:212715:x1876838003490304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896016.181284:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:212715:x1876838003490304:12345-0@lo:502:llog_process_th.0 Request processed in 78us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.181290:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:0.0:1789896016.181300:0:212715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212715:1876838003490304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.181328:0:212715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212715:1876838003490432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.181351:0:212715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896016.181370:0:212715:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.181376:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003490432 00000100:00100000:2.0:1789896016.181380:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003490432 00000100:00100000:2.0:1789896016.181405:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825 00000100:00100000:2.0:1789896016.181411:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:212715:x1876838003490432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896016.181454:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:212715:x1876838003490432:12345-0@lo:502:llog_process_th.0 Request processed in 44us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.181459:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825 00000100:00100000:0.0:1789896016.181476:0:212715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212715:1876838003490432:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896016.181495:0:212715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000020:01000000:2.0:1789896016.181527:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 144-146 (rc=0) 10000000:01000000:2.0:1789896016.181543:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896016.181548:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f70 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.181554:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f70 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896016.181563:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789896016.181564:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 166 10000000:01000000:2.0:1789896016.181566:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789896016.181575:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.181579:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.181584:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896016.181591:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003490560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.181606:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.181618:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7f021b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.181625:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003490560 00000100:00100000:0.0:1789896016.181629:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003490560 00000100:00100000:0.0:1789896016.181649:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826 00000100:00100000:0.0:1789896016.181653:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003490560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896016.181657:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896016.181663:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a1f7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1f77 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.181672:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a1f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1f77 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.181677:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a1f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f77 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.181681:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5ac00, rc 0) 00000100:00100000:0.0:1789896016.181704:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003490560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 51us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.181708:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826 00000100:00100000:2.0:1789896016.181718:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003490560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896016.181727:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f7e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.181733:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1f7e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896016.181754:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003490688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.181769:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.181780:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7f021b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.181788:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003490688 00000100:00100000:0.0:1789896016.181791:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003490688 00000100:00100000:0.0:1789896016.181810:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1827 00000100:00100000:0.0:1789896016.181813:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003490688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.181871:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003490688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.181878:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1827 00000100:00100000:2.0:1789896016.181879:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003490688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.181904:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003490816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.181925:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.181936:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7f021b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.181942:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003490816 00000100:00100000:0.0:1789896016.181946:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003490816 00000100:00100000:0.0:1789896016.181964:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:0.0:1789896016.181969:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003490816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.182036:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003490816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.182043:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000100:00100000:2.0:1789896016.182046:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003490816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.182237:0:212716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212716:1876838003490944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896016.182267:0:212716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.182300:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003490944 00000100:00100000:2.0:1789896016.182304:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003490944 00000100:00100000:0.0:1789896016.182305:0:212716:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa74d51b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.182325:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00100000:2.0:1789896016.182330:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:212716:x1876838003490944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896016.182394:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:212716:x1876838003490944:12345-0@lo:502:llog_process_th.0 Request processed in 63us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.182402:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00000100:00100000:0.0:1789896016.182408:0:212716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212716:1876838003490944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896016.182433:0:212716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789896016.182440:0:212716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896016.182442:0:212716:0:(obd_config.c:1561:class_process_config()) marker 155 (0x1) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:0.0:1789896016.182446:0:212716:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:0.0:1789896016.182454:0:212716:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from qpool1 00000020:01000004:0.0:1789896016.182786:0:212717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a952404000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789896016.182791:0:212717:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a952404000 4 00000100:00100000:3.0:1789896016.182801:0:212716:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e19180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212716:1876838003491072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896016.182848:0:212716:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896016.182870:0:212716:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa7f2bd540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896016.182877:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003491072 00000100:00100000:2.0:1789896016.182881:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003491072 00000100:00100000:2.0:1789896016.182903:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830 00000100:00100000:2.0:1789896016.182909:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:212716:x1876838003491072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896016.182962:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:212716:x1876838003491072:12345-0@lo:502:llog_process_th.0 Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896016.182966:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830 00000100:00100000:3.0:1789896016.183001:0:212716:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e19180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212716:1876838003491072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789896016.183024:0:212716:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789896016.183030:0:212716:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789896016.183032:0:212716:0:(obd_config.c:1561:class_process_config()) marker 155 (0x2) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:3.0:1789896016.183037:0:212716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 169 count 166 00000020:01000000:2.0:1789896016.183078:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 166-168 (rc=0) 10000000:01000000:2.0:1789896016.183090:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789896016.183095:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f7e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.183100:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f7e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896016.183113:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789896016.183114:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:2.0:1789896016.183116:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789896016.183126:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.183130:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.183135:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896016.183141:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003491200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.183158:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.183169:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a946b8bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.183190:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003491200 00000100:00100000:0.0:1789896016.183195:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003491200 00000100:00100000:0.0:1789896016.183251:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:0.0:1789896016.183258:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003491200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896016.183266:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896016.183274:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1f85 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.183302:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1f85 expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.183311:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f85 expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896016.183318:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a000, rc 0) 00000100:00100000:0.0:1789896016.183352:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003491200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.183357:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00100000:2.0:1789896016.183376:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003491200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896016.183386:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f8c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.183395:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1f8c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896016.183423:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003491328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896016.183440:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.183456:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a946b8bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896016.183463:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003491328 00000100:00100000:0.0:1789896016.183468:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003491328 00000100:00100000:0.0:1789896016.183493:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:0.0:1789896016.183498:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003491328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896016.183536:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003491328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 38us (95us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789896016.183542:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00000100:00100000:2.0:1789896016.183552:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003491328:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789896016.183572:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789896016.183575:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f8c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896016.183580:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1f8c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896016.300380:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789896016.300404:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003491456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789896016.300414:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003491584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789896016.300481:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896016.300487:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896016.300535:0:190237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003491456 00000100:00100000:1.0:1789896016.300538:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003491584 00000100:00100000:1.0:1789896016.300547:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003491584 00000100:00100000:0.0:1789896016.300547:0:190237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003491456 00000100:00080000:2.0:1789896016.300605:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789896016.300615:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789896016.300616:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789896016.300633:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003491584:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789896016.300634:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003491456:12345-0@lo:13:osp-pre-0-1.0 00000004:00000024:1.0:1789896016.300675:0:192489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445814272 avail 1299574784 00002000:00000024:0.0:1789896016.300675:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789896016.300736:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003491584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896016.300744:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789896016.300759:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003491456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896016.300780:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789896016.300786:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003491456:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789896016.300786:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003491584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789896016.876372:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789896017.058118:0:212766:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd5a575df0 20000000:00000080:0.0:1789896017.058136:0:212766:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91aa654f9800 uarg=0000000000000000 00000040:00100000:0.0:1789896017.058661:0:212766:0:(llog.c:1072:llog_reverse_process()) index 146 : idx 137 00000040:00100000:0.0:1789896017.058668:0:212766:0:(llog.c:1072:llog_reverse_process()) index 135 : idx 93 20000000:01000000:0.0:1789896017.058670:0:212766:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 135 cmd:0xce021 lustre.qpool1 lustre-OST0001_UUID 20000000:01000000:0.0:1789896017.058683:0:212766:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:0.0:1789896017.058938:0:212767:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 134 marker 145 1->4: lustre-clilov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:0.0:1789896017.058981:0:212767:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 137 marker 145 2->4: lustre-clilov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:0.0:1789896017.058990:0:212767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 147 count 144 00000040:00080000:3.0:1789896017.059116:0:212766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].147, 224 off34920 20000000:01000000:3.0:1789896017.059130:0:212766:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1789896017.059141:0:212766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].148, 128 off35048 00000040:00080000:3.0:1789896017.059150:0:212766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].149, 224 off35272 20000000:01000000:3.0:1789896017.059163:0:212766:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1789896017.059502:0:212768:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 157 marker 146 1->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:1.0:1789896017.059551:0:212768:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 159 marker 146 2->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:1.0:1789896017.059579:0:212768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 169 count 166 00000040:00080000:3.0:1789896017.059691:0:212766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].169, 224 off39072 20000000:01000000:3.0:1789896017.059699:0:212766:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1789896017.059708:0:212766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].170, 136 off39208 00000040:00080000:3.0:1789896017.059717:0:212766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].171, 224 off39432 20000000:01000000:3.0:1789896017.059724:0:212766:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1789896017.059977:0:212769:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 157 marker 147 1->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:1.0:1789896017.060001:0:212769:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 159 marker 147 2->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:1.0:1789896017.060018:0:212769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 169 count 166 00000040:00080000:3.0:1789896017.060116:0:212766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].169, 224 off39072 20000000:01000000:3.0:1789896017.060126:0:212766:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1789896017.060136:0:212766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].170, 136 off39208 00000040:00080000:3.0:1789896017.060145:0:212766:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].171, 224 off39432 10000000:01000000:3.0:1789896017.060154:0:212766:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789896017.060172:0:212766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060190:0:212766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f56e expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060196:0:212766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f575 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060353:0:212766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a1f1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f15 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060361:0:212766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1f2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f23 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060367:0:212766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a1f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f31 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060381:0:212766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a1f46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f3f expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060389:0:212766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a1f54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f4d expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060403:0:212766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a1f62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f5b expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060410:0:212766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a1f70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f69 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060415:0:212766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a1f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f77 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060420:0:212766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f85 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060424:0:212766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060462:0:212766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1f85 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060473:0:212766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1f85 expref: 23 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.060487:0:212766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e19180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003491712:0@lo:104: 00000100:00100000:3.0:1789896017.060553:0:212766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896017.060607:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003491712 00000100:00100000:1.0:1789896017.060616:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003491712 00010000:00010000:3.0:1789896017.060621:0:212766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a1f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1f77 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060628:0:212766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a1f7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1f77 expref: 23 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.060636:0:212766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e18e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003491840:0@lo:104: 00000100:00100000:3.0:1789896017.060658:0:212766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896017.060670:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003491840 00000100:00100000:1.0:1789896017.060674:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003491840 00010000:00010000:3.0:1789896017.060687:0:212766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a1f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1f69 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896017.060695:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00010000:00010000:3.0:1789896017.060697:0:212766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a1f70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1f69 expref: 23 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.060706:0:212766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003491968:0@lo:104: 00000100:00100000:0.0:1789896017.060707:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789896017.060710:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212766:x1876838003491712:12345-0@lo:104: 00010000:00010000:2.0:1789896017.060726:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f8c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.060726:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212766:x1876838003491840:12345-0@lo:104: 00000100:00100000:3.0:1789896017.060738:0:212766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896017.060738:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f7e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896017.060760:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003491968 00010000:00010000:3.0:1789896017.060765:0:212766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a1f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1f5b expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896017.060767:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003491968 00010000:00010000:3.0:1789896017.060778:0:212766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a1f62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1f5b expref: 23 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.060790:0:212766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003492096:0@lo:104: 00000100:00100000:1.0:1789896017.060805:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789896017.060816:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:212766:x1876838003491968:12345-0@lo:104: 00010000:00010000:0.0:1789896017.060816:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789896017.060824:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789896017.060832:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:212766:x1876838003491840:12345-0@lo:104: Request processed in 110us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896017.060837:0:212766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896017.060838:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:212766:x1876838003491712:12345-0@lo:104: Request processed in 131us (282us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896017.060840:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f70 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.060846:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1789896017.060858:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1789896017.060869:0:188715:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1789896017.060870:0:212766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a1f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1f4d expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060883:0:212766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a1f54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1f4d expref: 23 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.060885:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003492096 00000100:00100000:0.0:1789896017.060893:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003492096 00000100:00100000:3.0:1789896017.060896:0:212766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003492224:0@lo:104: 00010000:00010000:2.0:1789896017.060899:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789896017.060907:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f7e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.060918:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8e00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896017.060924:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1f7e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.060936:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00010000:00010000:1.0:1789896017.060948:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789896017.060951:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1f7e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.060960:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77101850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212766:x1876838003492096:12345-0@lo:104: 00000100:00100000:3.0:1789896017.060964:0:212766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896017.060968:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212766:x1876838003491968:12345-0@lo:104: Request processed in 149us (226us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896017.060986:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f62 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.060997:0:212766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a1f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1f3f expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896017.060999:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1f7e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896017.061000:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789896017.061022:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003492224 00010000:00010000:3.0:1789896017.061030:0:212766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a1f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1f3f expref: 23 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896017.061034:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896017.061035:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003492224 00000100:00100000:3.0:1789896017.061060:0:212766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003492352:0@lo:104: 00000100:00100000:1.0:1789896017.061068:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00010000:00010000:2.0:1789896017.061082:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f7e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896017.061091:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212766:x1876838003492224:12345-0@lo:104: 00010000:00010000:2.0:1789896017.061093:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896017.061102:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789896017.061104:0:212766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896017.061118:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f54 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.061120:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f7e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.061120:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77101850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212766:x1876838003492096:12345-0@lo:104: Request processed in 167us (283us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896017.061133:0:212766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a1f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1f31 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.061145:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00010000:00010000:2.0:1789896017.061153:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a1f77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f7e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.061163:0:212766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a1f38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1f31 expref: 23 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.061186:0:212766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003492608:0@lo:104: 00010000:00010000:2.0:1789896017.061192:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789896017.061234:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f8c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.061235:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003492352 00000100:00100000:0.0:1789896017.061243:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003492352 00010000:00010000:2.0:1789896017.061244:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9a00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896017.061248:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1f8c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.061255:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1f8c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896017.061260:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1f8c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.061262:0:212766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789896017.061284:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896017.061284:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003492608 00010000:00010000:1.0:1789896017.061294:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789896017.061294:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003492608 00000100:00100000:1.0:1789896017.061307:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:212766:x1876838003492224:12345-0@lo:104: Request processed in 229us (355us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896017.061309:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f8c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.061315:0:212766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1f23 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.061324:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00010000:00010000:2.0:1789896017.061337:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896017.061343:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1789896017.061345:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:212766:x1876838003492352:12345-0@lo:104: 00010000:00010000:3.0:1789896017.061350:0:212766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1f2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1f23 expref: 23 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.061356:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f8c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.061361:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f46 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896017.061377:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789896017.061379:0:212766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003492864:0@lo:104: 00010000:00010000:2.0:1789896017.061383:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9a00/0x412fd4b3617a1f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f8c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896017.061396:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212766:x1876838003492608:12345-0@lo:104: 00010000:00010000:1.0:1789896017.061409:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f38 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.061414:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789896017.061421:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f70 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.061430:0:212766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896017.061431:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8000 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:0.0:1789896017.061431:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:00010000:2.0:1789896017.061436:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1f70 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.061445:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1f70 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.061445:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212766:x1876838003492352:12345-0@lo:104: Request processed in 103us (340us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896017.061457:0:212766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a1f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1f15 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896017.061459:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1f70 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.061464:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00010000:00010000:1.0:1789896017.061467:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:3.0:1789896017.061476:0:212766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a1f1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1f15 expref: 23 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.061484:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003492864 10000000:01000000:2.0:1789896017.061488:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896017.061492:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003492864 00000100:00100000:1.0:1789896017.061495:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212766:x1876838003492608:12345-0@lo:104: Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896017.061517:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00010000:00010000:2.0:1789896017.061518:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f70 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.061524:0:212766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003492992:0@lo:104: 00000100:00100000:0.0:1789896017.061528:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00010000:00010000:2.0:1789896017.061537:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896017.061547:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212766:x1876838003492864:12345-0@lo:104: 00010000:00010000:1.0:1789896017.061560:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789896017.061561:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f2a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.061562:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f70 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896017.061573:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f62 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.061575:0:212766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896017.061597:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8000/0x412fd4b3617a1f69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f70 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.061604:0:212766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f575 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896017.061604:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9600 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896017.061612:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:1.0:1789896017.061615:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1f62 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.061619:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f54 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.061622:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1789896017.061649:0:212766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1f0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f575 expref: 9 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.061649:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212766:x1876838003492864:12345-0@lo:104: Request processed in 103us (215us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896017.061660:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1f62 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.061664:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9400 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896017.061675:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1f54 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.061706:0:212766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003493248:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789896017.061712:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 10000000:00010000:1.0:1789896017.061714:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1f62 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.061722:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1f54 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.061734:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003492992 00000100:00100000:0.0:1789896017.061742:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003492992 10000000:01000000:1.0:1789896017.061744:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896017.061759:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 10000000:00010000:2.0:1789896017.061761:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1f54 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896017.061766:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896017.061770:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212766:x1876838003492992:12345-0@lo:104: 00010000:00010000:0.0:1789896017.061779:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f1c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.061784:0:212766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f56e expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.061792:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f54 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896017.061796:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f62 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.061802:0:212766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1f07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f56e expref: 9 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.061808:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:2.0:1789896017.061809:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896017.061821:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f54 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.061831:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212766:x1876838003492992:12345-0@lo:104: Request processed in 60us (262us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896017.061843:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896017.061857:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a1f4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f54 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.061859:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1789896017.061860:0:212766:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003493376:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789896017.061862:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f62 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896017.061880:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a1f5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f62 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.061896:0:212766:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00010000:00010000:2.0:1789896017.061900:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1789896017.061901:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003492736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896017.061904:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f46 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896017.061908:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789896017.061911:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8200 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896017.061913:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f38 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896017.061916:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1f46 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.061925:0:212766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e19180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003491712:0@lo:104: 00000100:00100000:0.0:1789896017.061943:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896017.061946:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9200 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896017.061949:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1f46 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896017.061954:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1f38 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.061961:0:212766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e18e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003491840:0@lo:104: 10000000:00010000:2.0:1789896017.061961:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1f46 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.061970:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789896017.061988:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003493120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896017.061991:0:212766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003491968:0@lo:104: 10000000:01000000:2.0:1789896017.061996:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789896017.062011:0:212766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003492096:0@lo:104: 00010000:00010000:2.0:1789896017.062024:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f46 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.062028:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.062030:0:212766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003492224:0@lo:104: 00010000:00010000:2.0:1789896017.062049:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896017.062053:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789896017.062055:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1f38 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.062058:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f2a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.062062:0:212766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003492352:0@lo:104: 00010000:00010000:2.0:1789896017.062063:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f46 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896017.062092:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1f38 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.062093:0:212766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003492608:0@lo:104: 00010000:00010000:0.0:1789896017.062097:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6200 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896017.062100:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a1f3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f46 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896017.062107:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1f2a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.062117:0:212766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003492864:0@lo:104: 10000000:01000000:1.0:1789896017.062147:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789896017.062148:0:212766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003492992:0@lo:104: 00010000:00010000:0.0:1789896017.062150:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1f2a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.062151:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789896017.062157:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1f1c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896017.062174:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f38 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.062186:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896017.062224:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7e00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896017.062229:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1f1c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.062237:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1f1c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896017.062243:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1f1c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.062256:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896017.062258:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1789896017.062265:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896017.062290:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f38 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.062296:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003493504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896017.062306:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a1f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f38 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.062308:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f1c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.062320:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896017.062334:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f1c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896017.062338:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896017.062345:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896017.062346:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896017.062348:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a1f15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f1c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896017.062354:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1f2a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896017.062358:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789896017.062364:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896017.062376:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896017.062380:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896017.062382:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896017.062392:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f2a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896017.062394:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003493888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896017.062403:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789896017.062408:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003494016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896017.062408:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f2a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.062418:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a1f23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1f2a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896017.062439:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896017.062440:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896017.062445:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896017.062449:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896017.062462:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896017.062466:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789896017.062474:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003492736 00000100:00100000:2.0:1789896017.062475:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003493760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896017.062480:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003492736 00000100:00100000:3.0:1789896017.062485:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789896017.062492:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003492480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896017.062506:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f85 expref: 24 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896017.062526:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.062535:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896017.062547:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003493120 00000100:00100000:0.0:1789896017.062551:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003493120 00000100:00100000:1.0:1789896017.062562:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003493504 00010000:00010000:0.0:1789896017.062569:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a1f70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f69 expref: 25 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896017.062570:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003493504 00000100:00100000:2.0:1789896017.062571:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003493888 00000100:00100000:2.0:1789896017.062581:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003493888 00000100:00100000:0.0:1789896017.062594:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003494016 00000100:00100000:0.0:1789896017.062599:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003494016 00000100:00100000:3.0:1789896017.062605:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003493632:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896017.062611:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a1f38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f31 expref: 28 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896017.062613:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a1f54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f4d expref: 28 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.062613:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a1f1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f15 expref: 28 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.062636:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896017.062655:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003493760 00000100:00100000:3.0:1789896017.062656:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003494144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896017.062664:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003493760 00010000:00010000:2.0:1789896017.062687:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a1f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f3f expref: 29 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.062693:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003492480 00000100:00100000:0.0:1789896017.062698:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003492480 00000100:00100000:1.0:1789896017.062700:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003493632 00000100:00100000:3.0:1789896017.062708:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896017.062709:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003493632 00000100:00100000:2.0:1789896017.062714:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00010000:00010000:0.0:1789896017.062718:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a1f7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f77 expref: 31 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896017.062725:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+31:3617:x1876838003492736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896017.062736:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a1f62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f5b expref: 31 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.062737:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003494144 00010000:00010000:2.0:1789896017.062739:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789896017.062745:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003494144 00010000:00010000:2.0:1789896017.062756:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1f8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f85 expref: 32 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.062765:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1f2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f23 expref: 32 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.062776:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1f85 expref: 32 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.062794:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1789896017.062818:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+32:3617:x1876838003493120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896017.062830:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a1f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1f85 expref: 32 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.062838:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00010000:00010000:2.0:1789896017.062842:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896017.062852:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789896017.062853:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+31:3618:x1876838003493888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896017.062867:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896017.062875:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+31:3615:x1876838003494016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896017.062876:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a1f38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f31 expref: 31 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896017.062890:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+31:3617:x1876838003492736:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (951us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896017.062900:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896017.062906:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896017.062910:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a1f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1f31 expref: 31 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896017.062913:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a1f1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f15 expref: 31 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896017.062915:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00010000:00010000:3.0:1789896017.062922:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a1f70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f69 expref: 31 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896017.062948:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00010000:00010000:0.0:1789896017.062962:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a1f38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1f31 expref: 30 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896017.062966:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+30:3615:x1876838003493504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896017.062973:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a1f1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1f15 expref: 30 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.063013:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896017.063015:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a1f70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1f69 expref: 29 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.063020:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a1f54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f4d expref: 29 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.063032:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896017.063046:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a1f1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1f15 expref: 29 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.063053:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a1f70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1f69 expref: 29 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.063054:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a1f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1f4d expref: 29 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.063080:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+29:3618:x1876838003493888:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (633us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896017.063089:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896017.063096:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a1f54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1f4d expref: 28 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.063096:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00010000:00010000:3.0:1789896017.063115:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896017.063118:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896017.063139:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1789896017.063160:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a9514b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003493760:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896017.063162:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3615:x1876838003494016:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896017.063170:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3617:x1876838003493120:12345-0@lo:103:ldlm_bl.0 Request processed in 352us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.063178:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3615:x1876838003493504:12345-0@lo:103:ldlm_bl.0 Request processed in 208us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896017.063236:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00010000:00010000:0.0:1789896017.063241:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896017.063243:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00010000:00010000:0.0:1789896017.063250:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a1f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f3f expref: 25 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.063256:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00010000:00010000:0.0:1789896017.063264:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a1f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1f3f expref: 23 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896017.063291:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00010000:00010000:0.0:1789896017.063292:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a1f46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1f3f expref: 22 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896017.063306:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00010000:00010000:0.0:1789896017.063312:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896017.063314:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3615:x1876838003492480:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896017.063322:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3615:x1876838003494144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896017.063332:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896017.063335:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896017.063340:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a1f7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f77 expref: 21 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.063342:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1f2a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f23 expref: 21 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.063348:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a9514b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3618:x1876838003493760:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896017.063378:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1789896017.063398:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00010000:00010000:1.0:1789896017.063401:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a1f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1f77 expref: 21 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.063407:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3615:x1876838003493632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896017.063437:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896017.063438:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1f2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1f23 expref: 20 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.063446:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a1f62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f5b expref: 20 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896017.063456:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a1f7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1f77 expref: 20 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.063462:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1f2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1f23 expref: 20 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.063466:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a1f62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1f5b expref: 20 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.063493:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003494016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896017.063501:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896017.063506:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a800/0x412fd4b3617a1f62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1f5b expref: 19 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.063517:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003493504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896017.063529:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3615:x1876838003494144:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.063545:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00010000:00010000:1.0:1789896017.063548:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896017.063550:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896017.063565:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003494144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896017.063596:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003493760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896017.063617:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3615:x1876838003492480:12345-0@lo:103:ldlm_bl.0 Request processed in 308us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896017.063622:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003492480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896017.063624:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003493888:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896017.063640:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1789896017.063665:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003493632:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896017.063670:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3615:x1876838003493632:12345-0@lo:103:ldlm_bl.0 Request processed in 268us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896017.063678:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1789896017.063696:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003493120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896017.063710:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003492736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896017.063767:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896017.063786:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896017.063812:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015943808 00000100:00100000:0.0:1789896017.063817:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015943808 00000100:00100000:3.0:1789896017.063819:0:212766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003493248:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789896017.063823:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015943936 00000100:00100000:2.0:1789896017.063827:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015943936 00000100:00100000:3.0:1789896017.063833:0:212766:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212766:1876838003493376:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789896017.063835:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1f0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f575 expref: 11 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.063843:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1f07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f56e expref: 11 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.063867:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 436 00000100:00100000:2.0:1789896017.063874:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 437 00000100:00100000:0.0:1789896017.063879:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d545500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015943808:12345-192.168.202.44@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789896017.063889:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d545c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015943936:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789896017.063895:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896017.063897:0:212766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.063898:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896017.063902:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1f0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f575 expref: 11 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.063906:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1f07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f56e expref: 11 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.063925:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f575 expref: 11 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.063935:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f56e expref: 11 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.063947:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1f0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f575 expref: 11 pid: 188723 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.063950:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1f07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f56e expref: 11 pid: 188725 timeout: 3989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.063961:0:188718:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.063968:0:188718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.063974:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896017.063978:0:188718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.063984:0:188718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.063989:0:188718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.063994:0:188718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.063997:0:188718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3400 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:0.0:1789896017.064000:0:188718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896017.064002:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d545c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+9:2403:x1876838015943936:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 121us (215us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896017.064028:0:188718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896017.064029:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 437 00010000:00010000:0.0:1789896017.064048:0:188718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.064059:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896017.064074:0:212766:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.064083:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d545500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+8:2404:x1876838015943808:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 206us (314us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896017.064086:0:212766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896017.064096:0:212766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3400/0x412fd4b3617a1f93 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 212766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896017.064096:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 436 10000000:01000000:3.0:1789896017.396357:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789896017.396374:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 147 10000000:01000000:3.0:1789896017.396401:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789896017.396458:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.396473:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.396486:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.396517:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003494272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.396604:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896017.396664:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003494272 00000100:00100000:3.0:1789896017.396665:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:0.0:1789896017.396673:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003494272 00000100:00100000:0.0:1789896017.396728:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:0.0:1789896017.396737:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003494272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896017.396749:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896017.396763:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1fa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1f9a expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.396787:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1f9a expref: 16 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.396800:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f9a expref: 16 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.396811:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b800, rc 0) 00000100:00100000:0.0:1789896017.396855:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003494272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896017.396860:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00100000:3.0:1789896017.396898:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003494272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896017.396915:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fa1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.396926:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1fa1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.397002:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003494400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.397025:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.397043:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:0.0:1789896017.397080:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003494400 00000100:00100000:0.0:1789896017.397086:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003494400 00000100:00100000:0.0:1789896017.397113:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834 00000100:00100000:0.0:1789896017.397120:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003494400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896017.397283:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003494400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896017.397292:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834 00000100:00100000:3.0:1789896017.397315:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003494400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.397347:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003494528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.397393:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.397416:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:0.0:1789896017.397433:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003494528 00000100:00100000:0.0:1789896017.397439:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003494528 00000100:00100000:0.0:1789896017.397464:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835 00000100:00100000:0.0:1789896017.397470:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003494528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896017.397551:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003494528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896017.397559:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835 00000100:00100000:3.0:1789896017.397585:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003494528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896017.397927:0:212770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212770:1876838003494656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896017.397964:0:212770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896017.397987:0:212770:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.398012:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003494656 00000100:00100000:2.0:1789896017.398017:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003494656 00000100:00100000:2.0:1789896017.398046:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:2.0:1789896017.398054:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:212770:x1876838003494656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.398133:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:212770:x1876838003494656:12345-0@lo:502:llog_process_th.0 Request processed in 81us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.398138:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000100:00100000:0.0:1789896017.398170:0:212770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212770:1876838003494656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896017.398226:0:212770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212770:1876838003494784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896017.398257:0:212770:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896017.398292:0:212770:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534dacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.398302:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003494784 00000100:00100000:2.0:1789896017.398306:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003494784 00000100:00100000:2.0:1789896017.398328:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1837 00000100:00100000:2.0:1789896017.398332:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:212770:x1876838003494784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.398381:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:212770:x1876838003494784:12345-0@lo:502:llog_process_th.0 Request processed in 48us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.398386:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1837 00000100:00100000:0.0:1789896017.398409:0:212770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212770:1876838003494784:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896017.398430:0:212770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000020:01000000:3.0:1789896017.398521:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 147-149 (rc=0) 10000000:01000000:3.0:1789896017.398543:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896017.398549:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fa1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.398555:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fa1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896017.398561:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789896017.398563:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:3.0:1789896017.398564:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789896017.398576:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.398581:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.398586:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.398594:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003494912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.398613:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.398627:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.398655:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003494912 00000100:00100000:2.0:1789896017.398658:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003494912 00000100:00100000:2.0:1789896017.398680:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838 00000100:00100000:2.0:1789896017.398684:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003494912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896017.398689:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896017.398697:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1faf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1fa8 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.398709:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1fa8 expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.398723:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1fa8 expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.398728:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9000, rc 0) 00000100:00100000:2.0:1789896017.398756:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003494912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.398764:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838 00000100:00100000:3.0:1789896017.398783:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003494912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896017.398791:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1faf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.398796:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1faf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.398827:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003495040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.398845:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.398859:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.398886:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003495040 00000100:00100000:2.0:1789896017.398892:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003495040 00000100:00100000:2.0:1789896017.398923:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:2.0:1789896017.398928:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003495040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.398994:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003495040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.399003:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00100000:3.0:1789896017.399024:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003495040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.399051:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003495168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.399083:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.399107:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.399125:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003495168 00000100:00100000:2.0:1789896017.399130:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003495168 00000100:00100000:2.0:1789896017.399156:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840 00000100:00100000:2.0:1789896017.399163:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003495168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.399258:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003495168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.399278:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840 00000100:00100000:3.0:1789896017.399305:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003495168:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789896017.400111:0:212771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:3.0:1789896017.400171:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:3.0:1789896017.400187:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789896017.400191:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1faf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.400213:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1faf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896017.400219:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789896017.400221:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 147 10000000:01000000:3.0:1789896017.400223:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789896017.400234:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.400240:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.400245:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.400258:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003495296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.400288:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.400305:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.400328:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003495296 00000100:00100000:2.0:1789896017.400333:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003495296 00000100:00100000:2.0:1789896017.400363:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1841 00000100:00100000:2.0:1789896017.400370:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003495296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896017.400386:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896017.400394:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1fbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1fb6 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.400407:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1fb6 expref: 18 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.400412:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1fb6 expref: 18 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.400417:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9800, rc 0) 00000100:00100000:2.0:1789896017.400445:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003495296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.400449:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1841 00000100:00100000:3.0:1789896017.400487:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003495296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896017.400499:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fbd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.400508:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1fbd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.400547:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003495424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.400572:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.400588:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.400606:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003495424 00000100:00100000:2.0:1789896017.400610:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003495424 00000100:00100000:2.0:1789896017.400630:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842 00000100:00100000:2.0:1789896017.400634:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003495424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.400685:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003495424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 51us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.400689:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842 00000100:00100000:3.0:1789896017.400720:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003495424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.400744:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003495552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.400779:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.400803:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.400824:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003495552 00000100:00100000:2.0:1789896017.400828:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003495552 00000100:00100000:2.0:1789896017.400851:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:2.0:1789896017.400858:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003495552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.400918:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003495552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.400930:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00100000:3.0:1789896017.400938:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003495552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896017.401138:0:212772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212772:1876838003495680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896017.401175:0:212772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896017.401191:0:212772:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0780 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.401219:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003495680 00000100:00100000:2.0:1789896017.401224:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003495680 00000100:00100000:2.0:1789896017.401251:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844 00000100:00100000:2.0:1789896017.401257:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:212772:x1876838003495680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.401329:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:212772:x1876838003495680:12345-0@lo:502:llog_process_th.0 Request processed in 71us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.401336:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844 00000100:00100000:1.0:1789896017.401343:0:212772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212772:1876838003495680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896017.401388:0:212772:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212772:1876838003495808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896017.401419:0:212772:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896017.401443:0:212772:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0780 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.401449:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003495808 00000100:00100000:2.0:1789896017.401453:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003495808 00000100:00100000:2.0:1789896017.401471:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1845 00000100:00100000:2.0:1789896017.401476:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:212772:x1876838003495808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.401529:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:212772:x1876838003495808:12345-0@lo:502:llog_process_th.0 Request processed in 51us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896017.401534:0:212772:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212772:1876838003495808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.401539:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1845 00000040:00080000:1.0:1789896017.401552:0:212772:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000020:01000000:3.0:1789896017.401616:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 147-149 (rc=0) 10000000:01000000:3.0:1789896017.401629:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896017.401635:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fbd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.401643:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fbd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896017.401656:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789896017.401658:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:3.0:1789896017.401660:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789896017.401673:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.401685:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.401693:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.401705:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003495936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.401727:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.401742:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.401761:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003495936 00000100:00100000:2.0:1789896017.401765:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003495936 00000100:00100000:2.0:1789896017.401782:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846 00000100:00100000:2.0:1789896017.401789:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003495936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896017.401796:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896017.401804:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1fcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1fc4 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.401818:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1fc4 expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.401827:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1fc4 expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.401837:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8200, rc 0) 00000100:00100000:2.0:1789896017.401861:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003495936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.401867:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846 00000100:00100000:3.0:1789896017.401889:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003495936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896017.401901:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fcb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.401909:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1fcb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.401941:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003496064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.401970:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.401980:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.402000:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003496064 00000100:00100000:2.0:1789896017.402004:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003496064 00000100:00100000:2.0:1789896017.402030:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:2.0:1789896017.402036:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003496064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.402103:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003496064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.402110:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00100000:3.0:1789896017.402130:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003496064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.402154:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003496192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.402177:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.402188:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.402220:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003496192 00000100:00100000:2.0:1789896017.402225:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003496192 00000100:00100000:2.0:1789896017.402246:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:2.0:1789896017.402250:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003496192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.402320:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003496192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.402327:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00100000:3.0:1789896017.402335:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003496192:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789896017.402877:0:212773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:3.0:1789896017.402919:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:3.0:1789896017.402932:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789896017.402937:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fcb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.402945:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fcb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896017.402953:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789896017.402954:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 147 10000000:01000000:3.0:1789896017.402957:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789896017.402969:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.402976:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.402984:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.402995:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003496320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.403018:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.403037:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.403059:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003496320 00000100:00100000:2.0:1789896017.403064:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003496320 00000100:00100000:2.0:1789896017.403086:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849 00000100:00100000:2.0:1789896017.403090:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003496320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896017.403096:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896017.403104:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1fd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1fd2 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.403128:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1fd2 expref: 20 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.403137:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1fd2 expref: 20 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.403144:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9400, rc 0) 00000100:00100000:2.0:1789896017.403170:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003496320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.403178:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849 00000100:00100000:3.0:1789896017.403209:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003496320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896017.403226:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fd9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.403234:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1fd9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.403278:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003496448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.403302:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.403323:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.403333:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003496448 00000100:00100000:2.0:1789896017.403338:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003496448 00000100:00100000:2.0:1789896017.403367:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1850 00000100:00100000:2.0:1789896017.403377:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003496448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.403449:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003496448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.403457:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1850 00000100:00100000:3.0:1789896017.403460:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003496448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.403486:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003496576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.403515:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.403529:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.403541:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003496576 00000100:00100000:2.0:1789896017.403546:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003496576 00000100:00100000:2.0:1789896017.403569:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851 00000100:00100000:2.0:1789896017.403576:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003496576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.403635:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003496576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.403643:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851 00000100:00100000:3.0:1789896017.403647:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003496576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896017.403800:0:212774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212774:1876838003496704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896017.403832:0:212774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896017.403846:0:212774:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.403874:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003496704 00000100:00100000:2.0:1789896017.403880:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003496704 00000100:00100000:2.0:1789896017.403909:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1852 00000100:00100000:2.0:1789896017.403916:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:212774:x1876838003496704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.403983:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:212774:x1876838003496704:12345-0@lo:502:llog_process_th.0 Request processed in 67us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.403991:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1852 00000100:00100000:1.0:1789896017.403995:0:212774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212774:1876838003496704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896017.404026:0:212774:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212774:1876838003496832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896017.404048:0:212774:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896017.404059:0:212774:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.404074:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003496832 00000100:00100000:2.0:1789896017.404079:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003496832 00000100:00100000:2.0:1789896017.404102:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853 00000100:00100000:2.0:1789896017.404110:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:212774:x1876838003496832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.404174:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:212774:x1876838003496832:12345-0@lo:502:llog_process_th.0 Request processed in 64us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896017.404177:0:212774:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212774:1876838003496832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.404189:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853 00000040:00080000:1.0:1789896017.404215:0:212774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000020:01000000:3.0:1789896017.404289:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 147-149 (rc=0) 10000000:01000000:3.0:1789896017.404302:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896017.404307:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fd9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.404316:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fd9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896017.404322:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789896017.404324:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 169 10000000:01000000:3.0:1789896017.404326:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789896017.404339:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.404356:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.404364:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.404375:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003496960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.404396:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.404416:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.404426:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003496960 00000100:00100000:2.0:1789896017.404432:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003496960 00000100:00100000:2.0:1789896017.404456:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854 00000100:00100000:2.0:1789896017.404463:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003496960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896017.404471:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896017.404479:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a1fe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1fe0 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.404493:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a1fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1fe0 expref: 21 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.404501:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a1fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1fe0 expref: 21 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.404508:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8000, rc 0) 00000100:00100000:2.0:1789896017.404539:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003496960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.404552:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854 00000100:00100000:3.0:1789896017.404563:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003496960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896017.404575:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fe7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.404583:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1fe7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.404615:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003497088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.404635:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.404649:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.404662:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003497088 00000100:00100000:2.0:1789896017.404667:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003497088 00000100:00100000:2.0:1789896017.404691:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855 00000100:00100000:2.0:1789896017.404697:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003497088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.404760:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003497088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.404768:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855 00000100:00100000:3.0:1789896017.404774:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003497088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.404798:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003497216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.404826:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.404838:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.404849:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003497216 00000100:00100000:2.0:1789896017.404853:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003497216 00000100:00100000:2.0:1789896017.404871:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1856 00000100:00100000:2.0:1789896017.404874:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003497216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.404926:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003497216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 50us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.404931:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1856 00000100:00100000:3.0:1789896017.404942:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003497216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896017.405118:0:212775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212775:1876838003497344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896017.405147:0:212775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896017.405161:0:212775:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.405172:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003497344 00000100:00100000:2.0:1789896017.405177:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003497344 00000100:00100000:2.0:1789896017.405223:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:2.0:1789896017.405229:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:212775:x1876838003497344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.405302:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:212775:x1876838003497344:12345-0@lo:502:llog_process_th.0 Request processed in 73us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.405307:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00100000:1.0:1789896017.405313:0:212775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212775:1876838003497344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896017.405332:0:212775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896017.405340:0:212775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896017.405342:0:212775:0:(obd_config.c:1561:class_process_config()) marker 159 (0x1) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:1.0:1789896017.405345:0:212775:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1789896017.405364:0:212775:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool1 00000100:00100000:1.0:1789896017.405379:0:212775:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212775:1876838003497472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896017.405410:0:212775:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896017.405437:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003497472 00000100:00100000:1.0:1789896017.405437:0:212775:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.405441:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003497472 00000100:00100000:2.0:1789896017.405461:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858 00000100:00100000:2.0:1789896017.405465:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:212775:x1876838003497472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.405532:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:212775:x1876838003497472:12345-0@lo:502:llog_process_th.0 Request processed in 64us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896017.405535:0:212775:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212775:1876838003497472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.405546:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858 00000020:01000000:1.0:1789896017.405556:0:212775:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896017.405560:0:212775:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896017.405565:0:212775:0:(obd_config.c:1561:class_process_config()) marker 159 (0x2) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:1.0:1789896017.405568:0:212775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 172 count 169 00000020:01000000:3.0:1789896017.405619:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 169-171 (rc=0) 10000000:01000000:3.0:1789896017.405638:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789896017.405643:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fe7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.405651:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1fe7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896017.405659:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789896017.405661:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 147 10000000:01000000:3.0:1789896017.405663:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789896017.405674:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.405681:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.405689:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.405700:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003497600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.405722:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.405736:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.405745:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003497600 00000100:00100000:2.0:1789896017.405749:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003497600 00000100:00100000:2.0:1789896017.405767:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:2.0:1789896017.405772:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003497600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896017.405776:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896017.405782:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1ff5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1fee expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.405793:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1fee expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.405798:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1fee expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.405802:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9a00, rc 0) 00000100:00100000:2.0:1789896017.405824:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003497600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 53us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.405829:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00000100:00100000:3.0:1789896017.405844:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003497600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896017.405857:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1ff5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.405865:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a1ff5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.405896:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003497728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.405924:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.405938:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.405951:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003497728 00000100:00100000:2.0:1789896017.405956:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003497728 00000100:00100000:2.0:1789896017.405979:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1860 00000100:00100000:2.0:1789896017.405985:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003497728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.406041:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003497728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 56us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896017.406053:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003497728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.406060:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1860 00000100:00100000:3.0:1789896017.406078:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003497856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.406109:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.406122:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.406134:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003497856 00000100:00100000:2.0:1789896017.406138:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003497856 00000100:00100000:2.0:1789896017.406160:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861 00000100:00100000:2.0:1789896017.406168:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003497856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.406245:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003497856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.406254:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861 00000100:00100000:3.0:1789896017.406280:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003497856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896017.406441:0:212776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212776:1876838003497984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896017.406472:0:212776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896017.406496:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003497984 00000100:00100000:1.0:1789896017.406498:0:212776:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.406501:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003497984 00000100:00100000:2.0:1789896017.406530:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1862 00000100:00100000:2.0:1789896017.406537:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:212776:x1876838003497984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.406594:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:212776:x1876838003497984:12345-0@lo:502:llog_process_th.0 Request processed in 58us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.406600:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1862 00000100:00100000:1.0:1789896017.406604:0:212776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212776:1876838003497984:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896017.406632:0:212776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212776:1876838003498112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896017.406654:0:212776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896017.406666:0:212776:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.406676:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003498112 00000100:00100000:2.0:1789896017.406679:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003498112 00000100:00100000:2.0:1789896017.406697:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:2.0:1789896017.406701:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:212776:x1876838003498112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.406749:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:212776:x1876838003498112:12345-0@lo:502:llog_process_th.0 Request processed in 47us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.406755:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00100000:1.0:1789896017.406755:0:212776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212776:1876838003498112:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789896017.406781:0:212776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000020:01000000:3.0:1789896017.406838:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 147-149 (rc=0) 10000000:01000000:3.0:1789896017.406851:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896017.406856:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1ff5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.406865:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a1ff5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896017.406871:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789896017.406873:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 169 10000000:01000000:3.0:1789896017.406875:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789896017.406887:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.406895:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.406903:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.406913:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003498240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.406940:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.406954:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.406964:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003498240 00000100:00100000:2.0:1789896017.406967:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003498240 00000100:00100000:2.0:1789896017.406985:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1864 00000100:00100000:2.0:1789896017.406990:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003498240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896017.406999:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896017.407005:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2003 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a1ffc expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.407014:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a1ffc expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.407020:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1ffc expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.407024:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8e00, rc 0) 00000100:00100000:2.0:1789896017.407047:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003498240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 57us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.407051:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1864 00000100:00100000:3.0:1789896017.407066:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003498240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896017.407078:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2003 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.407086:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2003 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.407117:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003498368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.407141:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.407157:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.407161:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003498368 00000100:00100000:2.0:1789896017.407165:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003498368 00000100:00100000:2.0:1789896017.407182:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:2.0:1789896017.407187:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003498368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.407254:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003498368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.407259:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00100000:3.0:1789896017.407284:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003498368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.407307:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003498496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.407335:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.407358:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.407360:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003498496 00000100:00100000:2.0:1789896017.407364:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003498496 00000100:00100000:2.0:1789896017.407384:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:2.0:1789896017.407389:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003498496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.407436:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003498496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 47us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.407448:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00100000:3.0:1789896017.407451:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003498496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896017.407613:0:212777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212777:1876838003498624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896017.407643:0:212777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896017.407658:0:212777:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0000 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.407667:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003498624 00000100:00100000:2.0:1789896017.407671:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003498624 00000100:00100000:2.0:1789896017.407688:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:2.0:1789896017.407693:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:212777:x1876838003498624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896017.407750:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:212777:x1876838003498624:12345-0@lo:502:llog_process_th.0 Request processed in 57us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.407755:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000100:00100000:1.0:1789896017.407760:0:212777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212777:1876838003498624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896017.407783:0:212777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896017.407789:0:212777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896017.407791:0:212777:0:(obd_config.c:1561:class_process_config()) marker 158 (0x1) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:1.0:1789896017.407796:0:212777:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1789896017.407805:0:212777:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool1 00000020:01000004:1.0:1789896017.408088:0:212778:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a952404000 from lustre-MDT0000, refs=4 00000100:00100000:2.0:1789896017.408089:0:212777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212777:1876838003498752:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789896017.408093:0:212778:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a952404000 4 00000100:00100000:2.0:1789896017.408122:0:212777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896017.408141:0:212777:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94d302480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896017.408167:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003498752 00000100:00100000:0.0:1789896017.408173:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003498752 00000100:00100000:0.0:1789896017.408232:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1868 00000100:00100000:0.0:1789896017.408242:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:212777:x1876838003498752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896017.408351:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:212777:x1876838003498752:12345-0@lo:502:llog_process_th.0 Request processed in 111us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896017.408360:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1868 00000100:00100000:2.0:1789896017.408365:0:212777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212777:1876838003498752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789896017.408390:0:212777:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789896017.408394:0:212777:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896017.408396:0:212777:0:(obd_config.c:1561:class_process_config()) marker 158 (0x2) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789896017.408400:0:212777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 172 count 169 00000020:01000000:3.0:1789896017.408499:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 169-171 (rc=0) 10000000:01000000:3.0:1789896017.408514:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789896017.408519:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2003 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.408527:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2003 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896017.408535:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789896017.408542:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:3.0:1789896017.408544:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789896017.408556:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.408563:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.408571:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.408582:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003498880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.408605:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.408626:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896017.408630:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003498880 00000100:00100000:2.0:1789896017.408635:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003498880 00000100:00100000:2.0:1789896017.408658:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869 00000100:00100000:2.0:1789896017.408662:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003498880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896017.408667:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896017.408674:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a200a expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.408683:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a200a expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.408696:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a200a expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.408701:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8400, rc 0) 00000100:00100000:2.0:1789896017.408724:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003498880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 62us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.408728:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869 00000100:00100000:3.0:1789896017.408762:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003498880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896017.408772:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2011 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.408780:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2011 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896017.408806:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003499008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896017.408824:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896017.408840:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d900 going to sleep for 11 seconds 00000100:00100000:0.0:1789896017.408864:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003499008 00000100:00100000:0.0:1789896017.408869:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003499008 00000100:00100000:0.0:1789896017.408998:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870 00000100:00100000:0.0:1789896017.409007:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003499008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896017.409073:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003499008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (247us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789896017.409081:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870 00000100:00100000:3.0:1789896017.409110:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003499008:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789896017.409133:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789896017.409139:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2011 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896017.409159:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2011 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896017.843789:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896017.843865:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015944064 00000100:00100000:2.0:1789896017.843875:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015944064 00000100:00100000:2.0:1789896017.843928:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1871 00000100:00100000:2.0:1789896017.843937:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015944064:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896017.843954:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896017.843972:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2018 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f57c expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.844000:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f57c expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.844010:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f57c expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896017.844018:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8a00, rc 0) 00000100:00100000:2.0:1789896017.844069:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015944064:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 135us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.844075:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1871 00000100:00100000:3.0:1789896017.844901:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896017.844966:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015944192 00000100:00100000:0.0:1789896017.844972:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015944192 00000100:00100000:0.0:1789896017.845007:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1872 00000100:00100000:0.0:1789896017.845019:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015944192:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896017.845159:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015944192:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 138us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896017.845169:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1872 00000100:00100000:1.0:1789896017.845763:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896017.845814:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015944320 00000100:00100000:2.0:1789896017.845834:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015944320 00000100:00100000:2.0:1789896017.845862:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1873 00000100:00100000:2.0:1789896017.845869:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015944320:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.845953:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015944320:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 84us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.845960:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1873 00000100:00100000:1.0:1789896017.847064:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896017.847099:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015944448 00000100:00100000:0.0:1789896017.847105:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015944448 00000100:00100000:0.0:1789896017.847135:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1874 00000100:00100000:0.0:1789896017.847144:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:212616:x1876838015944448:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789896017.847228:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:212616:x1876838015944448:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 87us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896017.847242:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1874 00000100:00100000:3.0:1789896017.847926:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896017.847983:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015944576 00000100:00100000:2.0:1789896017.847988:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015944576 00000100:00100000:2.0:1789896017.848019:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1875 00000100:00100000:2.0:1789896017.848028:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:212616:x1876838015944576:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896017.848099:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:212616:x1876838015944576:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 72us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896017.848108:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1875 00000100:00100000:1.0:1789896017.848943:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896017.848987:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015944704 00000100:00100000:0.0:1789896017.848991:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015944704 00000100:00100000:0.0:1789896017.849017:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1876 00000100:00100000:0.0:1789896017.849021:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015944704:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896017.849029:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896017.849042:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a201f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f583 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.849066:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a201f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f583 expref: 10 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.849078:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a201f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f583 expref: 10 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896017.849087:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5ae00, rc 0) 00000100:00100000:0.0:1789896017.849114:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015944704:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 92us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896017.849119:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1876 00000100:00100000:1.0:1789896017.849701:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896017.849745:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015944832 00000100:00100000:2.0:1789896017.849750:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015944832 00000100:00100000:2.0:1789896017.849777:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1877 00000100:00100000:2.0:1789896017.849785:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015944832:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896017.849844:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015944832:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 58us (140us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789896017.849854:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1877 00010000:00010000:3.0:1789896017.900363:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789896018.616762:0:212876:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fff6584c9e0 20000000:00000080:3.0:1789896018.616782:0:212876:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91a94b922000 uarg=0000000000000000 00000040:00100000:3.0:1789896018.617361:0:212876:0:(llog.c:1072:llog_reverse_process()) index 149 : idx 137 20000000:01000000:3.0:1789896018.617367:0:212876:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 148 cmd:0xce022 lustre.qpool1 lustre-OST0001_UUID 20000000:01000000:3.0:1789896018.617382:0:212876:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.qpool1 fl=4 20000000:01000000:1.0:1789896018.617684:0:212877:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 128 marker 139 1->4: lustre-clilov new lustre.qpool1 20000000:01000000:1.0:1789896018.617737:0:212877:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 130 marker 139 2->4: lustre-clilov new lustre.qpool1 00000040:00080000:1.0:1789896018.617753:0:212877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 150 count 147 00000040:00080000:3.0:1789896018.617891:0:212876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].150, 224 off35496 20000000:01000000:3.0:1789896018.617908:0:212876:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:3.0:1789896018.617923:0:212876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].151, 104 off35600 00000040:00080000:3.0:1789896018.617936:0:212876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].152, 224 off35824 20000000:01000000:3.0:1789896018.617948:0:212876:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.qpool1 fl=4 20000000:01000000:1.0:1789896018.618187:0:212878:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 151 marker 140 1->4: lustre-MDT0000-mdtlov new lustre.qpool1 20000000:01000000:1.0:1789896018.618220:0:212878:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 153 marker 140 2->4: lustre-MDT0000-mdtlov new lustre.qpool1 00000040:00080000:1.0:1789896018.618238:0:212878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 172 count 169 00000040:00080000:3.0:1789896018.618612:0:212876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].172, 224 off39656 20000000:01000000:3.0:1789896018.618621:0:212876:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:3.0:1789896018.618634:0:212876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].173, 112 off39768 00000040:00080000:3.0:1789896018.618648:0:212876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].174, 224 off39992 20000000:01000000:3.0:1789896018.618657:0:212876:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.qpool1 fl=4 20000000:01000000:1.0:1789896018.618926:0:212879:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 151 marker 141 1->4: lustre-MDT0001-mdtlov new lustre.qpool1 20000000:01000000:1.0:1789896018.618944:0:212879:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 153 marker 141 2->4: lustre-MDT0001-mdtlov new lustre.qpool1 00000040:00080000:1.0:1789896018.618959:0:212879:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 172 count 169 00000040:00080000:3.0:1789896018.619043:0:212876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].172, 224 off39656 20000000:01000000:3.0:1789896018.619053:0:212876:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:3.0:1789896018.619066:0:212876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].173, 112 off39768 00000040:00080000:3.0:1789896018.619079:0:212876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].174, 224 off39992 10000000:01000000:3.0:1789896018.619090:0:212876:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789896018.619111:0:212876:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619291:0:212876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1f9a expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619299:0:212876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1faf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1fa8 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619305:0:212876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1fbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1fb6 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619312:0:212876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1fcb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1fc4 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619318:0:212876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1fd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1fd2 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619325:0:212876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a1fe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1fe0 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619330:0:212876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1ff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1fee expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619336:0:212876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2003 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a1ffc expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619342:0:212876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a200a expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619351:0:212876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2018 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f57c expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619366:0:212876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a201f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f583 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619374:0:212876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619416:0:212876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a201f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f583 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619433:0:212876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a201f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f583 expref: 9 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.619449:0:212876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003499136:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789896018.619559:0:212876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f57c expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619568:0:212876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2018 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f57c expref: 9 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.619577:0:212876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003499264:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789896018.619609:0:212876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a200a expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619617:0:212876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2011 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a200a expref: 23 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.619627:0:212876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003499392:0@lo:104: 00000100:00100000:3.0:1789896018.619681:0:212876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896018.619782:0:212876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1ffc expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896018.619790:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003499392 00010000:00010000:3.0:1789896018.619791:0:212876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2003 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1ffc expref: 23 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896018.619800:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003499392 00000100:00100000:3.0:1789896018.619845:0:212876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003499520:0@lo:104: 00000100:00100000:0.0:1789896018.619861:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1789896018.619873:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212876:x1876838003499392:12345-0@lo:104: 00000100:00100000:3.0:1789896018.619880:0:212876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896018.619888:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2011 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619915:0:212876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1fee expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.619926:0:212876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1ff5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1fee expref: 23 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.619933:0:188714:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789896018.619935:0:212876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003499648:0@lo:104: 00000100:00100000:1.0:1789896018.619952:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003499520 00000100:00100000:1.0:1789896018.619957:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003499520 00010000:00010000:0.0:1789896018.619972:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789896018.619986:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212876:x1876838003499392:12345-0@lo:104: Request processed in 115us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896018.619991:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1789896018.620000:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789896018.620003:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa654fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212876:x1876838003499520:12345-0@lo:104: 00010000:00010000:2.0:1789896018.620010:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789896018.620012:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2003 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.620021:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2011 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.620033:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3800 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896018.620038:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2011 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.620056:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2011 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896018.620065:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2011 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.620072:0:212876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789896018.620079:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896018.620085:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789896018.620095:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa654fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212876:x1876838003499520:12345-0@lo:104: Request processed in 93us (215us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896018.620105:0:212876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a1fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1fe0 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620106:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00010000:00010000:0.0:1789896018.620107:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896018.620117:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2003 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.620121:0:212876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a1fe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1fe0 expref: 23 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.620134:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2011 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620137:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3a00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896018.620144:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2003 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.620145:0:212876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003499776:0@lo:104: 00010000:00010000:2.0:1789896018.620149:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896018.620151:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003499648 00000100:00100000:1.0:1789896018.620157:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003499648 00010000:00010000:0.0:1789896018.620167:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2003 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896018.620175:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2003 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.620179:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2011 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.620185:0:212876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789896018.620188:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896018.620189:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1789896018.620219:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212876:x1876838003499648:12345-0@lo:104: 00010000:00010000:2.0:1789896018.620226:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3800/0x412fd4b3617a200a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2011 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.620229:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1ff5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620239:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2003 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.620249:0:212876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1fd2 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620264:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896018.620266:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896018.620270:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896018.620275:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896018.620277:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2003 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.620290:0:212876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1fd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1fd2 expref: 23 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620292:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3a00/0x412fd4b3617a1ffc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2003 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896018.620294:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789896018.620301:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 172 10000000:01000000:2.0:1789896018.620308:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00000100:00100000:3.0:1789896018.620319:0:212876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003500160:0@lo:104: 00010000:00010000:1.0:1789896018.620320:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789896018.620322:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896018.620328:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1ff5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620330:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212876:x1876838003499648:12345-0@lo:104: Request processed in 129us (260us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896018.620334:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620349:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00010000:00010000:2.0:1789896018.620355:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.620361:0:212876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896018.620365:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003499776 00010000:00010000:0.0:1789896018.620368:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3200 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:1.0:1789896018.620371:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003499776 10000000:00010000:0.0:1789896018.620374:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1ff5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.620379:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620385:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1ff5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620391:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003500160 00010000:00010000:3.0:1789896018.620392:0:212876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1fc4 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620397:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003500160 00010000:00010000:3.0:1789896018.620408:0:212876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1fcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1fc4 expref: 23 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896018.620408:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1ff5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620419:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 10000000:01000000:0.0:1789896018.620430:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896018.620432:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212876:x1876838003499776:12345-0@lo:104: 00000100:00100000:3.0:1789896018.620438:0:212876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003500416:0@lo:104: 00000100:00100000:2.0:1789896018.620440:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003500288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896018.620446:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1fe7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620456:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1ff5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620464:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789896018.620475:0:212876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896018.620486:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1ff5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620495:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3200/0x412fd4b3617a1fee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1ff5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.620508:0:212876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1fb6 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.620508:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789896018.620509:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789896018.620511:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896018.620517:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1fe7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620521:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212876:x1876838003499776:12345-0@lo:104: Request processed in 89us (337us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896018.620534:0:212876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1fbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1fb6 expref: 23 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620537:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2400 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:1.0:1789896018.620538:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1789896018.620540:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8e40 going to sleep for 11 seconds 10000000:00010000:0.0:1789896018.620545:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1fe7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.620557:0:212876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003500672:0@lo:104: 00000100:00100000:1.0:1789896018.620559:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003500416 00000100:00100000:2.0:1789896018.620564:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003499904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896018.620565:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003500416 00010000:00010000:0.0:1789896018.620578:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1fe7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620588:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 10000000:00010000:0.0:1789896018.620588:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1fe7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896018.620598:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896018.620600:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212876:x1876838003500160:12345-0@lo:104: 00000100:00100000:3.0:1789896018.620602:0:212876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896018.620612:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896018.620614:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1fd9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620620:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fe7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620628:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896018.620632:0:212876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1fa8 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620639:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fe7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.620644:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789896018.620645:0:212876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1faf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1fa8 expref: 23 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620654:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d2400/0x412fd4b3617a1fe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fe7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.620657:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003500032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896018.620659:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789896018.620662:0:212876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003500928:0@lo:104: 00000100:00100000:1.0:1789896018.620672:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212876:x1876838003500160:12345-0@lo:104: Request processed in 74us (312us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896018.620676:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896018.620681:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1fd9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620699:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789896018.620700:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896018.620701:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3400 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896018.620707:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1fd9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620715:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003500672 00010000:00010000:0.0:1789896018.620716:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1fd9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620722:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003500672 10000000:00010000:0.0:1789896018.620729:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1fd9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896018.620742:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896018.620747:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1789896018.620749:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003500288 00000100:00100000:2.0:1789896018.620756:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003500288 00000100:00100000:1.0:1789896018.620757:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212876:x1876838003500416:12345-0@lo:104: 00000100:00100000:3.0:1789896018.620765:0:212876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896018.620765:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fd9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620774:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896018.620777:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1fcb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620794:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fd9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.620796:0:212876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a1f9a expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.620801:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878 00010000:00010000:0.0:1789896018.620813:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3400/0x412fd4b3617a1fd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fd9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.620819:0:212876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1fa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a1f9a expref: 24 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.620820:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003500288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896018.620821:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789896018.620826:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896018.620831:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1fcb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620841:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212876:x1876838003500416:12345-0@lo:104: Request processed in 78us (358us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896018.620842:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896018.620842:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2800 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896018.620848:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1fcb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620855:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00010000:00010000:0.0:1789896018.620857:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1fcb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.620859:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2034 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a202d expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896018.620863:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1fcb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620869:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003500928 00000100:00100000:1.0:1789896018.620878:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003500928 10000000:01000000:0.0:1789896018.620879:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896018.620898:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fcb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620899:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789896018.620912:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212876:x1876838003500672:12345-0@lo:104: 00010000:00010000:0.0:1789896018.620918:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896018.620919:0:188725:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.620922:0:212876:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003501184:0@lo:104: 00010000:00010000:1.0:1789896018.620924:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1fbd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620937:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fcb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.620944:0:188725:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2034 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a202d expref: 25 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620951:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a1fc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fcb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.620964:0:212876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896018.620966:0:188725:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620970:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896018.620975:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896018.620978:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789896018.620980:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789896018.620983:0:212876:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a40f9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789896018.620985:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2034 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a202d expref: 25 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.620986:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1fbd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.620989:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212876:x1876838003500672:12345-0@lo:104: Request processed in 77us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896018.621008:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1789896018.621009:0:212876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003499392:0@lo:104: 00010000:00010000:0.0:1789896018.621009:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3e00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896018.621016:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1fbd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.621025:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1fbd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.621028:0:212876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003499520:0@lo:104: 00000100:00100000:1.0:1789896018.621032:0:188714:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789896018.621042:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8600, rc 0) 10000000:00010000:0.0:1789896018.621044:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1fbd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.621045:0:212876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003499648:0@lo:104: 00000100:00100000:1.0:1789896018.621046:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003501184 00000100:00100000:1.0:1789896018.621052:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003501184 10000000:01000000:0.0:1789896018.621057:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896018.621073:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00010000:00010000:0.0:1789896018.621073:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fbd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.621081:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896018.621086:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fbd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.621087:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212876:x1876838003500928:12345-0@lo:104: 00000100:00100000:2.0:1789896018.621093:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:188728:x1876838003500288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 278us (583us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896018.621094:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a1fb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fbd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.621108:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1faf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.621111:0:212876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003499776:0@lo:104: 00000100:00100000:2.0:1789896018.621114:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878 00010000:00010000:0.0:1789896018.621117:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896018.621122:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896018.621126:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896018.621135:0:212876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003500160:0@lo:104: 00000100:00100000:0.0:1789896018.621138:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003500544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896018.621152:0:212876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003500416:0@lo:104: 00000100:00100000:2.0:1789896018.621160:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003499904 00000100:00100000:2.0:1789896018.621166:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003499904 00000100:00100000:3.0:1789896018.621168:0:212876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003500672:0@lo:104: 00010000:00010000:1.0:1789896018.621169:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789896018.621177:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896018.621183:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:212876:x1876838003500928:12345-0@lo:104: Request processed in 97us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896018.621191:0:212876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003500928:0@lo:104: 00010000:00010000:2.0:1789896018.621191:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2011 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a200a expref: 25 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.621193:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1789896018.621217:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003501440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896018.621238:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896018.621246:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1789896018.621272:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94b084c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212876:x1876838003501184:12345-0@lo:104: 00000100:00100000:2.0:1789896018.621273:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:3.0:1789896018.621277:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003500032 00010000:00010000:1.0:1789896018.621283:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1fa1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.621284:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003500032 00000100:00100000:0.0:1789896018.621288:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789896018.621291:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3617:x1876838003499904:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896018.621297:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003500800:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896018.621305:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2003 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1ffc expref: 26 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.621310:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896018.621321:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2011 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a200a expref: 26 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896018.621331:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896018.621336:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003500544 00010000:00010000:2.0:1789896018.621338:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a200a expref: 26 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.621341:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789896018.621343:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003500544 00000100:00100000:1.0:1789896018.621353:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94b084c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:212876:x1876838003501184:12345-0@lo:104: Request processed in 98us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896018.621359:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003501440 00010000:00010000:3.0:1789896018.621361:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1ff5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1fee expref: 27 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.621362:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a2011 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a200a expref: 27 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.621363:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789896018.621364:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003501440 00010000:00010000:0.0:1789896018.621382:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1fbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1fb6 expref: 28 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.621389:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896018.621392:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003500800 00000100:00100000:3.0:1789896018.621397:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003500800 00000100:00100000:0.0:1789896018.621405:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00010000:00010000:1.0:1789896018.621411:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789896018.621415:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a1fe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1fe0 expref: 28 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896018.621418:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3617:x1876838003500032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896018.621420:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1faf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.621425:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3617:x1876838003499904:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (813us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896018.621436:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896018.621444:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2c00 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:2.0:1789896018.621446:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00010000:00010000:0.0:1789896018.621447:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2003 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1ffc expref: 28 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896018.621452:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1faf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.621469:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1faf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.621469:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2003 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1ffc expref: 27 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.621470:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1789896018.621482:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:3.0:1789896018.621485:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+27:3615:x1876838003500544:12345-0@lo:103:ldlm_bl.0 10000000:00010000:1.0:1789896018.621494:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1faf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.621498:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2003 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1ffc expref: 27 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.621499:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+27:3615:x1876838003501440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896018.621500:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896018.621510:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1ff5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1fee expref: 27 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896018.621522:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896018.621524:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896018.621536:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1fbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1fb6 expref: 26 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.621538:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1fee expref: 26 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.621547:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1faf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.621559:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896018.621559:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896018.621563:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1fb6 expref: 26 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.621576:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1faf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.621582:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a1ff5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1fee expref: 26 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.621584:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a1fa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1faf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.621587:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a1fbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1fb6 expref: 26 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896018.621591:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3617:x1876838003500032:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896018.621610:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00010000:00010000:1.0:1789896018.621614:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789896018.621618:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896018.621618:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a1fa1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.621619:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896018.621626:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3c00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896018.621629:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a1fa1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.621634:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a1fa1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896018.621639:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a1fa1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896018.621643:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896018.621653:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00010000:00010000:1.0:1789896018.621661:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fa1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896018.621662:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3615:x1876838003500800:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896018.621667:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3615:x1876838003500544:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896018.621670:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3615:x1876838003501440:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (429us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896018.621677:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896018.621681:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896018.621684:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a1fe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1fe0 expref: 23 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.621689:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00010000:00010000:1.0:1789896018.621694:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fa1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.621699:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a1fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1fe0 expref: 23 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.621700:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00010000:00010000:1.0:1789896018.621705:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a1f9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a1fa1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.621722:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896018.621722:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a1fe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1fe0 expref: 21 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.621727:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896018.621731:0:212876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003501184:0@lo:104: 00010000:00010000:1.0:1789896018.621732:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896018.621733:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896018.621744:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003501312:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896018.621744:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896018.621756:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896018.621756:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3615:x1876838003500800:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896018.621764:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1789896018.621778:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896018.621802:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896018.621805:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003501312 00000100:00100000:2.0:1789896018.621807:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00010000:00010000:0.0:1789896018.621808:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896018.621810:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003501312 00000100:00100000:2.0:1789896018.621818:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003501056:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896018.621831:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1fcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1fc4 expref: 20 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896018.621846:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003501568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896018.621855:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896018.621878:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003500800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896018.621891:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896018.621892:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003501696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896018.621896:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003500544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896018.621903:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003501056 00000100:00100000:3.0:1789896018.621908:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003501056 00000100:00100000:1.0:1789896018.621915:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003501440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896018.621928:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1fd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1fd2 expref: 21 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.621935:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896018.621942:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896018.621964:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003501568 00000100:00100000:3.0:1789896018.621974:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003501568 00000100:00100000:2.0:1789896018.621975:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003501696 00000100:00100000:2.0:1789896018.621980:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003501696 00000100:00100000:1.0:1789896018.621989:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003500032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896018.621990:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1faf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1fa8 expref: 23 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896018.621995:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:2.0:1789896018.622002:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1fa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f9a expref: 23 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.622013:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003499904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896018.622015:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015944960 00000100:00100000:3.0:1789896018.622021:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015944960 00000100:00100000:0.0:1789896018.622024:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015945088 00000100:00100000:2.0:1789896018.622028:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1789896018.622036:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015945088 00010000:00010000:3.0:1789896018.622040:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2018 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f57c expref: 10 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.622041:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950859f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3618:x1876838003501312:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896018.622050:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003500288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896018.622060:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00010000:00010000:2.0:1789896018.622060:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896018.622060:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a201f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f583 expref: 11 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.622068:0:188728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622069:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1fcb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1fc4 expref: 23 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.622075:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3618:x1876838003501056:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896018.622090:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00010000:00010000:3.0:1789896018.622091:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896018.622093:0:188728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 4/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622095:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1fc4 expref: 23 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.622101:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1fd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1fd2 expref: 23 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896018.622104:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3616:x1876838003501568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896018.622121:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896018.622127:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a1fcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1fc4 expref: 23 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.622129:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1fd2 expref: 23 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.622130:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1faf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1fa8 expref: 23 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.622135:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1789896018.622149:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3618:x1876838003501696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896018.622152:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896018.622158:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a1fd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1fd2 expref: 22 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.622168:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1fa8 expref: 22 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.622173:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896018.622180:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1fa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a1f9a expref: 21 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.622182:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896018.622190:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a1faf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1fa8 expref: 21 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.622191:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950859f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3618:x1876838003501312:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (410us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896018.622194:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a1f9a expref: 21 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.622227:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b800/0x412fd4b3617a1fa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a1f9a expref: 21 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.622236:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00010000:00010000:0.0:1789896018.622244:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896018.622247:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896018.622273:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 447 00000100:00100000:2.0:1789896018.622284:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015944960:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789896018.622292:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896018.622297:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2018 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f57c expref: 11 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622307:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2018 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f57c expref: 11 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622320:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896018.622469:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a53c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015944960:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 186us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896018.622474:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3618:x1876838003501056:12345-0@lo:103:ldlm_bl.0 Request processed in 401us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896018.622483:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3618:x1876838003501696:12345-0@lo:103:ldlm_bl.0 Request processed in 335us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896018.622487:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 447 00000100:00100000:0.0:1789896018.622487:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3616:x1876838003501568:12345-0@lo:103:ldlm_bl.0 Request processed in 384us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896018.622498:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1789896018.622505:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:0.0:1789896018.622511:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:2.0:1789896018.622519:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 448 00000100:00100000:2.0:1789896018.622537:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+10:2404:x1876838015945088:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789896018.622547:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896018.622554:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a201f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f583 expref: 10 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896018.622563:0:212876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003499136:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789896018.622568:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a201f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f583 expref: 10 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.622571:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d547480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003501568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896018.622583:0:212876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2018 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f57c expref: 10 pid: 188723 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622591:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a201f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f583 expref: 10 pid: 188725 timeout: 3990 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896018.622592:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003501056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896018.622598:0:212876:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:212876:1876838003499264:192.168.202.44@tcp:104: 00000100:00100000:0.0:1789896018.622606:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003501696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896018.622609:0:199629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622616:0:199629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896018.622619:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003501312:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896018.622635:0:199629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622641:0:199629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622646:0:199629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622651:0:199629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622655:0:199629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2a00 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:2.0:1789896018.622659:0:199629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622674:0:199629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.622677:0:212876:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622689:0:199629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x412fd4b3617a202d expref: 15 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622697:0:199629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x412fd4b3617a202d expref: 15 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.622728:0:212876:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896018.622737:0:212876:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.622739:0:199629:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a202d expref: 15 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.622756:0:199629:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:MGS:199629:1876838003501824:0@lo:105: 00000100:00100000:2.0:1789896018.622786:0:199629:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896018.622815:0:199629:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789896018.622829:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003501824 00000100:00100000:1.0:1789896018.622835:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003501824 00000100:00100000:1.0:1789896018.622878:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1789896018.622886:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:199629:x1876838003501824:12345-0@lo:105: 00010000:00010000:1.0:1789896018.622894:0:188714:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.622903:0:188714:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 5/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.622912:0:188714:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 5/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.622930:0:188714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.622938:0:188714:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 6/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896018.622960:0:188714:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff91aa654e9c00) 00010000:00010000:2.0:1789896018.622988:0:188728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.622998:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:199629:x1876838003501824:12345-0@lo:105: Request processed in 112us (211us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896018.623000:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.623008:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1789896018.623067:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003501952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896018.623099:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896018.623122:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fe540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896018.623137:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003501952 00000100:00100000:0.0:1789896018.623143:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003501952 00000100:00100000:2.0:1789896018.623147:0:199629:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:MGS:199629:1876838003501824:0@lo:105: 00010000:00010000:2.0:1789896018.623162:0:199629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896018.623185:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00010000:00010000:2.0:1789896018.623192:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2a00/0x412fd4b3617a2026 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 212876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896018.623224:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003501952:12345-0@lo:501:ll_cfg_requeue.0 00010000:00010000:2.0:1789896018.623231:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896018.623278:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+8:2404:x1876838015945088:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 743us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896018.623288:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 448 00000100:00100000:0.0:1789896018.623357:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003501952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 163us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896018.623366:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00100000:2.0:1789896018.623376:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003501952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896018.623407:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003502080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896018.623458:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896018.623484:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fe540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896018.623499:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003502080 00000100:00100000:0.0:1789896018.623504:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003502080 00000100:00100000:0.0:1789896018.623534:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1880 00000100:00100000:0.0:1789896018.623540:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003502080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896018.623620:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003502080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896018.623628:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1880 00000100:00100000:2.0:1789896018.623641:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003502080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896018.623831:0:212880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212880:1876838003502208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896018.623866:0:212880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896018.623885:0:212880:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da300 going to sleep for 11 seconds 00000100:00100000:2.0:1789896018.623897:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003502208 00000100:00100000:2.0:1789896018.623901:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003502208 00000100:00100000:2.0:1789896018.623926:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881 00000100:00100000:2.0:1789896018.623932:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:212880:x1876838003502208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896018.624010:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:212880:x1876838003502208:12345-0@lo:502:llog_process_th.0 Request processed in 78us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896018.624016:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881 00000100:00100000:0.0:1789896018.624042:0:212880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212880:1876838003502208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896018.624067:0:212880:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789896018.624079:0:212880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896018.624082:0:212880:0:(obd_config.c:1561:class_process_config()) marker 161 (0x1) lustre-MDT0000-m del lustre.qpool1 00000020:00000080:0.0:1789896018.624087:0:212880:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1789896018.624862:0:212880:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212880:1876838003502336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896018.624895:0:212880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896018.624930:0:212880:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789896018.624933:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003502336 00000100:00100000:1.0:1789896018.624939:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003502336 00000100:00100000:1.0:1789896018.624975:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882 00000100:00100000:1.0:1789896018.624983:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:212880:x1876838003502336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896018.625067:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:212880:x1876838003502336:12345-0@lo:502:llog_process_th.0 Request processed in 84us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896018.625075:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882 00000100:00100000:0.0:1789896018.625085:0:212880:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212880:1876838003502336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896018.625107:0:212880:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789896018.625112:0:212880:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896018.625114:0:212880:0:(obd_config.c:1561:class_process_config()) marker 161 (0x2) lustre-MDT0000-m del lustre.qpool1 00000040:00080000:0.0:1789896018.625124:0:212880:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 175 count 172 00000020:01000000:2.0:1789896018.625168:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 172-174 (rc=0) 10000000:01000000:2.0:1789896018.625191:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789896018.625196:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.625222:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896018.625236:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789896018.625239:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:2.0:1789896018.625242:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789896018.625269:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.625277:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.625284:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.625295:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003502464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896018.625320:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896018.625347:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fe240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896018.625347:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003502464 00000100:00100000:0.0:1789896018.625354:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003502464 00000100:00100000:0.0:1789896018.625383:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883 00000100:00100000:0.0:1789896018.625391:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003502464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896018.625399:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896018.625408:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2042 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a203b expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.625423:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a203b expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.625432:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a203b expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.625439:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b600, rc 0) 00000100:00100000:0.0:1789896018.625472:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003502464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896018.625481:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003502464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896018.625482:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883 00010000:00010000:2.0:1789896018.625497:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2042 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.625505:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2042 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896018.625538:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003502592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896018.625560:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896018.625575:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fe240 going to sleep for 11 seconds 00000100:00100000:1.0:1789896018.625594:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003502592 00000100:00100000:1.0:1789896018.625599:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003502592 00000100:00100000:1.0:1789896018.625626:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1884 00000100:00100000:1.0:1789896018.625634:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003502592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896018.625676:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003502592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 44us (116us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789896018.625682:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1884 00000100:00100000:2.0:1789896018.625687:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003502592:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789896018.625714:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789896018.625719:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2042 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896018.625725:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2042 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896018.803679:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896018.803716:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896018.803742:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015945344 00000100:00100000:0.0:1789896018.803752:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015945344 00000100:00100000:2.0:1789896018.803772:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015945216 00000100:00100000:2.0:1789896018.803777:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015945216 00000100:00080000:3.0:1789896018.803817:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789896018.803824:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789896018.803835:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 474 00000100:00100000:0.0:1789896018.803843:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 475 00000100:00100000:2.0:1789896018.803848:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2404:x1876838015945216:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789896018.803858:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2403:x1876838015945344:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789896018.803923:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2404:x1876838015945216:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 81us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896018.803928:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2403:x1876838015945344:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 72us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896018.803933:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 474 00000100:00100000:0.0:1789896018.803943:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 475 00000100:00100000:2.0:1789896018.899727:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896018.899823:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015945472 00000100:00100000:0.0:1789896018.899835:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015945472 00000100:00100000:0.0:1789896018.899909:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1885 00000100:00100000:0.0:1789896018.899918:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015945472:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896018.899936:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896018.899955:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f58a expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.899984:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f58a expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.899993:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f58a expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.900000:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5be00, rc 0) 00000100:00100000:0.0:1789896018.900053:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015945472:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 137us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896018.900058:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1885 00000100:00100000:1.0:1789896018.900880:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896018.900916:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015945600 00000100:00100000:0.0:1789896018.900920:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015945600 00000100:00100000:0.0:1789896018.900943:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1886 00000100:00100000:0.0:1789896018.900947:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015945600:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896018.901058:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015945600:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 110us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896018.901063:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1886 00000100:00100000:1.0:1789896018.901637:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896018.901674:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015945728 00000100:00100000:0.0:1789896018.901679:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015945728 00000100:00100000:0.0:1789896018.901701:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1887 00000100:00100000:0.0:1789896018.901705:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015945728:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896018.901782:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015945728:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 76us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896018.901787:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1887 00000100:00100000:2.0:1789896018.902764:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896018.902798:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015945856 00000100:00100000:0.0:1789896018.902803:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015945856 00000100:00100000:0.0:1789896018.902832:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1888 00000100:00100000:0.0:1789896018.902842:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:212634:x1876838015945856:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789896018.902932:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:212634:x1876838015945856:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 91us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896018.902941:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1888 00000100:00100000:1.0:1789896018.903569:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896018.903605:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015945984 00000100:00100000:0.0:1789896018.903609:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015945984 00000100:00100000:0.0:1789896018.903628:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1889 00000100:00100000:0.0:1789896018.903633:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:212634:x1876838015945984:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789896018.903681:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:212634:x1876838015945984:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 47us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896018.903687:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1889 00000100:00100000:1.0:1789896018.904464:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896018.904495:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015946112 00000100:00100000:0.0:1789896018.904499:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015946112 00000100:00100000:0.0:1789896018.904519:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1890 00000100:00100000:0.0:1789896018.904523:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015946112:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896018.904529:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896018.904536:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2050 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f591 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.904563:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f591 expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.904572:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f591 expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896018.904579:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b400, rc 0) 00000100:00100000:0.0:1789896018.904608:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015946112:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 83us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896018.904615:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1890 00000100:00100000:2.0:1789896018.905195:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896018.905260:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015946240 00000100:00100000:0.0:1789896018.905265:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015946240 00000100:00100000:0.0:1789896018.905285:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1891 00000100:00100000:0.0:1789896018.905290:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015946240:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896018.905329:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015946240:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 39us (134us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789896018.905333:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1891 00010000:00010000:1.0:1789896018.924414:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896019.372421:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003502976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789896019.372440:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789896019.372461:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003502720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789896019.372535:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.372547:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003503232:0@lo:400:kworker.0 00000100:00100000:3.0:1789896019.372584:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003502848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789896019.372585:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003502720 00000100:00100000:2.0:1789896019.372596:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003502720 00000100:00100000:0.0:1789896019.372596:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896019.372601:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896019.372618:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003503488:0@lo:400:kworker.0 00000100:00100000:0.0:1789896019.372636:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003503744:0@lo:400:kworker.0 00000100:00100000:1.0:1789896019.372649:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003503360:0@lo:400:kworker.0 00000100:00100000:3.0:1789896019.372653:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.372665:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.372670:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003502976 00000100:00100000:2.0:1789896019.372675:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003502976 00000100:00100000:3.0:1789896019.372693:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003504000:0@lo:400:kworker.0 00000100:00100000:0.0:1789896019.372695:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876838003504256:0@lo:400:kworker.0 00000100:00100000:1.0:1789896019.372703:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.372708:0:196139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789896019.372721:0:196139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003502720:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789896019.372735:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003503872:0@lo:400:kworker.0 00000100:00100000:3.0:1789896019.372745:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.372746:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789896019.372757:0:196139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789896019.372770:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896019.372776:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876838003504512:0@lo:400:kworker.0 00000100:00100000:1.0:1789896019.372803:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876838003504384:0@lo:400:kworker.0 00000100:00100000:0.0:1789896019.372803:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003503232 00000100:00100000:0.0:1789896019.372808:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003503232 00000100:00100000:3.0:1789896019.372813:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.372817:0:196139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003502720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.372827:0:196139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789896019.372840:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789896019.372844:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.372844:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003503744 00000100:00100000:3.0:1789896019.372850:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003503104:0@lo:400:kworker.0 00000100:00100000:0.0:1789896019.372850:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003503744 00000100:00100000:2.0:1789896019.372860:0:196139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789896019.372872:0:196139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003502976:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789896019.372883:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789896019.372892:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789896019.372893:0:196139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789896019.372893:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003504256 00000100:00100000:0.0:1789896019.372894:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003503232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896019.372901:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003504256 00000100:00100000:3.0:1789896019.372941:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876838003503616:0@lo:400:kworker.0 00000100:00100000:2.0:1789896019.372951:0:196139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003502976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896019.372952:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003504512 00000100:00100000:0.0:1789896019.372953:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003503232:12345-0@lo:400:kworker.0 Request processed in 62us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896019.372959:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003504512 00000100:00100000:2.0:1789896019.372968:0:196139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789896019.372969:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.372971:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789896019.372994:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789896019.372996:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003504384 00000100:00100000:3.0:1789896019.373000:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876838003504128:0@lo:400:kworker.0 00000100:00100000:1.0:1789896019.373002:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003504384 00000100:00100000:2.0:1789896019.373005:0:191519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003503488 00000100:00100000:0.0:1789896019.373005:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003503744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896019.373012:0:191519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003503488 00000100:00100000:3.0:1789896019.373029:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896019.373037:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003503616 00000100:00100000:1.0:1789896019.373042:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003503616 00000100:00100000:3.0:1789896019.373051:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876838003504640:0@lo:400:kworker.0 00000100:00100000:2.0:1789896019.373052:0:191519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003503360 00000100:00100000:0.0:1789896019.373058:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003503744:12345-0@lo:400:kworker.0 Request processed in 54us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.373059:0:191519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003503360 00000100:00100000:1.0:1789896019.373062:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003504128 00000100:00100000:1.0:1789896019.373068:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003504128 00000100:00100000:0.0:1789896019.373072:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789896019.373083:0:191519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003504000 00000100:00100000:3.0:1789896019.373089:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.373089:0:191519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003504000 00000100:00100000:1.0:1789896019.373094:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003504640 00000100:00100000:1.0:1789896019.373100:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003504640 00000100:00100000:0.0:1789896019.373111:0:191520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003503872 00000100:00100000:0.0:1789896019.373117:0:191520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003503872 00000100:00100000:2.0:1789896019.373121:0:191519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789896019.373130:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:2.0:1789896019.373135:0:191519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003503488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896019.373140:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1789896019.373145:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3617:x1876838003504256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896019.373151:0:191520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789896019.373162:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3615:x1876838003504512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896019.373163:0:191520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7f377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003503360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896019.373183:0:191519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003503488:12345-0@lo:400:kworker.0 Request processed in 53us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.373191:0:191519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789896019.373229:0:191519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789896019.373235:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3617:x1876838003504256:12345-0@lo:400:kworker.0 Request processed in 91us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.373242:0:191519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003504000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896019.373257:0:191520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7f377c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003503360:12345-0@lo:400:kworker.0 Request processed in 85us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896019.373261:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1789896019.373262:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3615:x1876838003504512:12345-0@lo:400:kworker.0 Request processed in 108us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.373275:0:191520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789896019.373278:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1789896019.373297:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1789896019.373303:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1789896019.373304:0:191519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003504000:12345-0@lo:400:kworker.0 Request processed in 64us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896019.373309:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876838003504384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896019.373316:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3615:x1876838003503616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896019.373319:0:191519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789896019.373341:0:191519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789896019.373352:0:191519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003503872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896019.373370:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876838003504384:12345-0@lo:400:kworker.0 Request processed in 63us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896019.373371:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3615:x1876838003503616:12345-0@lo:400:kworker.0 Request processed in 58us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896019.373383:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1789896019.373394:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1789896019.373396:0:191519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003503872:12345-0@lo:400:kworker.0 Request processed in 44us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896019.373402:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1789896019.373406:0:191519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789896019.373412:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3615:x1876838003504128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896019.373420:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:1.0:1789896019.373430:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876838003504640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896019.373466:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3615:x1876838003504128:12345-0@lo:400:kworker.0 Request processed in 56us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.373469:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003503360:0@lo:400:kworker.0 00000100:00100000:3.0:1789896019.373475:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:1.0:1789896019.373480:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876838003504640:12345-0@lo:400:kworker.0 Request processed in 50us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.373491:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003503872:0@lo:400:kworker.0 00000100:00100000:1.0:1789896019.373491:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00080000:3.0:1789896019.373508:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789896019.373514:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a948bc7100 x1876838003504384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789896019.373515:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789896019.373521:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789896019.373526:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789896019.373532:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876838003504384:0@lo:400:kworker.0 00000100:00100000:1.0:1789896019.373536:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896019.373555:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876838003503616:0@lo:400:kworker.0 00000100:00100000:2.0:1789896019.373572:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003502976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789896019.373574:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876838003504128:0@lo:400:kworker.0 00000100:00100000:1.0:1789896019.373594:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003502720:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789896019.373605:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a948bc7480 x1876838003504640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789896019.373612:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3615:1876838003504640:0@lo:400:kworker.0 00000100:00100000:3.0:1789896019.373624:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003503488:0@lo:400:kworker.0 00000100:00100000:3.0:1789896019.373634:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003504000:0@lo:400:kworker.0 00000100:00100000:2.0:1789896019.373639:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003502848 00000100:00100000:2.0:1789896019.373644:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003502848 00000100:00100000:3.0:1789896019.373645:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876838003504512:0@lo:400:kworker.0 00000100:00100000:2.0:1789896019.373679:0:196139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789896019.373679:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003503104 00000100:00100000:1.0:1789896019.373685:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003503104 00000100:00100000:2.0:1789896019.373691:0:196139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003502848:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789896019.373693:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003503232:0@lo:400:kworker.0 00002000:00000024:2.0:1789896019.373706:0:196139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789896019.373714:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003503744:0@lo:400:kworker.0 00000100:00100000:1.0:1789896019.373727:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892 00000100:00100000:0.0:1789896019.373732:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876838003504256:0@lo:400:kworker.0 00000100:00100000:1.0:1789896019.373738:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:3615:x1876838003503104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896019.373750:0:196139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003502848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.373757:0:196139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789896019.373765:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003502848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789896019.373786:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:3615:x1876838003503104:12345-0@lo:400:kworker.0 Request processed in 50us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896019.373793:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892 00000100:00100000:0.0:1789896019.373812:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003503104:0@lo:400:kworker.0 10000000:01000000:3.0:1789896019.820287:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789896019.820294:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 150 10000000:01000000:3.0:1789896019.820297:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789896019.820345:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896019.820356:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896019.820365:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896019.820389:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003504768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896019.820467:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.820519:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003504768 00000100:00100000:3.0:1789896019.820520:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a40f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.820528:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003504768 00000100:00100000:0.0:1789896019.820583:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893 00000100:00100000:0.0:1789896019.820592:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003504768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896019.820607:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896019.820620:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a205e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2057 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.820644:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a205e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2057 expref: 18 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.820652:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a205e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2057 expref: 18 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.820659:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a000, rc 0) 00000100:00100000:0.0:1789896019.820703:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003504768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.820710:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893 00000100:00100000:3.0:1789896019.820737:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003504768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896019.820752:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a205e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896019.820773:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a205e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896019.820839:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003504896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896019.820866:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896019.820890:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a40f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.820910:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003504896 00000100:00100000:0.0:1789896019.820915:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003504896 00000100:00100000:0.0:1789896019.820937:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:0.0:1789896019.820943:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003504896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896019.821078:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003504896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.821084:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000100:00100000:3.0:1789896019.821106:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003504896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896019.821140:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003505024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896019.821188:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.821228:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003505024 00000100:00100000:0.0:1789896019.821231:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003505024 00000100:00100000:3.0:1789896019.821251:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a40f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.821265:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1895 00000100:00100000:0.0:1789896019.821277:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003505024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896019.821345:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003505024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.821351:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1895 00000100:00100000:3.0:1789896019.821370:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003505024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896019.821605:0:212908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212908:1876838003505152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896019.821641:0:212908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896019.821657:0:212908:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a40f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.821676:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003505152 00000100:00100000:0.0:1789896019.821680:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003505152 00000100:00100000:0.0:1789896019.821703:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896 00000100:00100000:0.0:1789896019.821709:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:212908:x1876838003505152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896019.821793:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:212908:x1876838003505152:12345-0@lo:502:llog_process_th.0 Request processed in 84us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.821798:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896 00000100:00100000:3.0:1789896019.821825:0:212908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212908:1876838003505152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896019.821877:0:212908:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212908:1876838003505280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896019.821925:0:212908:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896019.821942:0:212908:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa50343540 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.821958:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003505280 00000100:00100000:0.0:1789896019.821962:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003505280 00000100:00100000:0.0:1789896019.821984:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:0.0:1789896019.821991:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:212908:x1876838003505280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896019.822077:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:212908:x1876838003505280:12345-0@lo:502:llog_process_th.0 Request processed in 86us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.822084:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00000100:00100000:3.0:1789896019.822089:0:212908:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212908:1876838003505280:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789896019.822112:0:212908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000020:01000000:2.0:1789896019.822226:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 150-152 (rc=0) 10000000:01000000:2.0:1789896019.822264:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896019.822271:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a205e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.822278:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a205e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896019.822284:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789896019.822286:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:2.0:1789896019.822288:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789896019.822302:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.822312:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.822318:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896019.822327:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003505408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.822354:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.822381:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.822407:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003505408 00000100:00100000:0.0:1789896019.822413:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003505408 00000100:00100000:0.0:1789896019.822440:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:0.0:1789896019.822449:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003505408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896019.822455:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896019.822464:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a206c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2065 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.822486:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a206c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2065 expref: 19 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.822493:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a206c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2065 expref: 19 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.822498:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a400, rc 0) 00000100:00100000:0.0:1789896019.822535:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003505408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.822540:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00100000:2.0:1789896019.822561:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003505408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896019.822572:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a206c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.822580:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a206c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896019.822630:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003505536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.822652:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.822674:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9499fef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.823167:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003505536 00000100:00100000:0.0:1789896019.823172:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003505536 00000100:00100000:2.0:1789896019.823235:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1899 00000100:00100000:2.0:1789896019.823258:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003505536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.823358:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003505536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 104us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896019.823367:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003505536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.823368:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1899 00000100:00100000:3.0:1789896019.823399:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003505664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896019.823451:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896019.823480:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a40f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.823502:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003505664 00000100:00100000:0.0:1789896019.823508:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003505664 00000100:00100000:0.0:1789896019.823552:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:0.0:1789896019.823562:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003505664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896019.823650:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003505664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.823658:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00100000:3.0:1789896019.823679:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003505664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789896019.824424:0:212909:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:0.0:1789896019.824491:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:0.0:1789896019.824686:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789896019.824693:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a206c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.824701:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a206c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896019.824715:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896019.824717:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 150 10000000:01000000:0.0:1789896019.824719:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896019.824736:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.824741:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.824747:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896019.824758:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003505792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896019.824785:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.824831:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896019.824854:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003505792 00000100:00100000:2.0:1789896019.824862:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003505792 00000100:00100000:2.0:1789896019.824890:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:2.0:1789896019.824902:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003505792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896019.824911:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896019.824923:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a207a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2073 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.824940:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a207a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2073 expref: 20 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.824950:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a207a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2073 expref: 20 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.824958:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9600, rc 0) 00000100:00100000:2.0:1789896019.824990:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003505792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.824996:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:0.0:1789896019.825002:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003505792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896019.825018:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a207a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.825028:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a207a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896019.825077:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003505920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896019.825104:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.825119:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789896019.825144:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003505920 00000100:00100000:1.0:1789896019.825150:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003505920 00000100:00100000:1.0:1789896019.825194:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00100000:1.0:1789896019.825230:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003505920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896019.825340:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003505920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896019.825349:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00100000:0.0:1789896019.825356:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003505920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896019.825388:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003506048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896019.825424:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.825449:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896019.825463:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003506048 00000100:00100000:2.0:1789896019.825469:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003506048 00000100:00100000:2.0:1789896019.825495:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1903 00000100:00100000:2.0:1789896019.825502:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003506048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.825587:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003506048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.825590:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003506048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.825603:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1903 00000100:00100000:0.0:1789896019.825780:0:212911:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212911:1876838003506176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896019.825806:0:212911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.825819:0:212911:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa467f06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789896019.825839:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003506176 00000100:00100000:1.0:1789896019.825844:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003506176 00000100:00100000:1.0:1789896019.825876:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:1.0:1789896019.825885:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:212911:x1876838003506176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896019.825961:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:212911:x1876838003506176:12345-0@lo:502:llog_process_th.0 Request processed in 78us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896019.825969:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00100000:0.0:1789896019.825969:0:212911:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212911:1876838003506176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896019.826011:0:212911:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212911:1876838003506304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896019.826044:0:212911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.826061:0:212911:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa467f06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896019.826085:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003506304 00000100:00100000:2.0:1789896019.826091:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003506304 00000100:00100000:2.0:1789896019.826118:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905 00000100:00100000:2.0:1789896019.826127:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:212911:x1876838003506304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896019.826229:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:212911:x1876838003506304:12345-0@lo:502:llog_process_th.0 Request processed in 104us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.826238:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905 00000100:00100000:0.0:1789896019.826254:0:212911:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212911:1876838003506304:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896019.826277:0:212911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000020:01000000:2.0:1789896019.826318:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 150-152 (rc=0) 10000000:01000000:2.0:1789896019.826356:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896019.826362:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a207a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.826372:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a207a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896019.826380:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789896019.826382:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:2.0:1789896019.826384:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789896019.826401:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.826409:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.826416:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896019.826429:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003506432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.826457:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.826483:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789896019.826498:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003506432 00000100:00100000:1.0:1789896019.826504:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003506432 00000100:00100000:1.0:1789896019.826538:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906 00000100:00100000:1.0:1789896019.826547:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003506432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896019.826555:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896019.826566:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a2088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2081 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896019.826582:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a2088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2081 expref: 21 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896019.826591:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a2088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2081 expref: 21 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896019.826598:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c7a00, rc 0) 00000100:00100000:1.0:1789896019.826632:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003506432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896019.826639:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906 00000100:00100000:2.0:1789896019.826662:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003506432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896019.826673:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2088 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.826690:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2088 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896019.826732:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003506560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.826760:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.826782:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.826791:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003506560 00000100:00100000:0.0:1789896019.826795:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003506560 00000100:00100000:0.0:1789896019.826818:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1907 00000100:00100000:0.0:1789896019.826824:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003506560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896019.826883:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003506560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.826888:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1907 00000100:00100000:2.0:1789896019.826899:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003506560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.826931:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003506688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.826973:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.827005:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789896019.827012:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003506688 00000100:00100000:1.0:1789896019.827018:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003506688 00000100:00100000:1.0:1789896019.827056:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:1.0:1789896019.827065:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003506688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896019.827151:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003506688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896019.827159:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00100000:2.0:1789896019.827164:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003506688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789896019.827909:0:212912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:2.0:1789896019.827956:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:2.0:1789896019.827977:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789896019.827983:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2088 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.827992:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2088 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896019.828000:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896019.828002:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 150 10000000:01000000:2.0:1789896019.828005:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896019.828021:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.828029:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.828043:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896019.828057:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003506816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.828090:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.828122:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003506816 00000100:00100000:2.0:1789896019.828124:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.828127:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003506816 00000100:00100000:0.0:1789896019.828158:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:0.0:1789896019.828170:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003506816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896019.828177:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896019.828185:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a2096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a208f expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.828196:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a2096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a208f expref: 22 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.828222:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a2096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a208f expref: 22 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.828228:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5ba00, rc 0) 00000100:00100000:0.0:1789896019.828269:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003506816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.828274:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1789896019.828296:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003506816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896019.828309:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2096 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.828317:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2096 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896019.828356:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003506944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.828387:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896019.828424:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003506944 00000100:00100000:2.0:1789896019.828428:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789896019.828429:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003506944 00000100:00100000:1.0:1789896019.828464:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:1.0:1789896019.828474:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003506944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896019.828544:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003506944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896019.828552:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00100000:2.0:1789896019.828574:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003506944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.828599:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003507072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.828635:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.828654:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.828665:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003507072 00000100:00100000:0.0:1789896019.828669:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003507072 00000100:00100000:0.0:1789896019.828690:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1911 00000100:00100000:0.0:1789896019.828696:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003507072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896019.828751:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003507072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.828756:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1911 00000100:00100000:2.0:1789896019.828767:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003507072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896019.828944:0:212913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212913:1876838003507200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896019.828978:0:212913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.828998:0:212913:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa4774f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896019.829003:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003507200 00000100:00100000:2.0:1789896019.829008:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003507200 00000100:00100000:2.0:1789896019.829038:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:2.0:1789896019.829045:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:212913:x1876838003507200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896019.829139:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:212913:x1876838003507200:12345-0@lo:502:llog_process_th.0 Request processed in 94us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.829147:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00100000:0.0:1789896019.829150:0:212913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212913:1876838003507200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896019.829182:0:212913:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212913:1876838003507328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896019.829230:0:212913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.829268:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003507328 00000100:00100000:0.0:1789896019.829271:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003507328 00000100:00100000:0.0:1789896019.829303:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:0.0:1789896019.829313:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:212913:x1876838003507328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896019.829367:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:212913:x1876838003507328:12345-0@lo:502:llog_process_th.0 Request processed in 59us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.829372:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:0.0:1789896019.829424:0:212913:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa42a780c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.829438:0:212913:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212913:1876838003507328:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896019.829463:0:212913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000020:01000000:3.0:1789896019.829504:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 150-152 (rc=0) 10000000:01000000:3.0:1789896019.829522:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896019.829528:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2096 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896019.829535:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2096 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896019.829541:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789896019.829542:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 172 10000000:01000000:3.0:1789896019.829544:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789896019.829556:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896019.829561:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896019.829567:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896019.829576:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003507456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896019.829609:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896019.829631:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789896019.829646:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003507456 00000100:00100000:1.0:1789896019.829652:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003507456 00000100:00100000:1.0:1789896019.829681:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:1.0:1789896019.829690:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003507456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896019.829698:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896019.829708:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a20a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a209d expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896019.829724:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a20a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a209d expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896019.829734:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a20a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a209d expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896019.829742:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c7c00, rc 0) 00000100:00100000:1.0:1789896019.829779:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003507456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896019.829784:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003507456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896019.829804:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896019.829804:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00010000:00010000:3.0:1789896019.829812:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a20a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896019.829848:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003507584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896019.829867:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896019.829883:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a950b0dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.829898:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003507584 00000100:00100000:0.0:1789896019.829903:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003507584 00000100:00100000:0.0:1789896019.829935:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1915 00000100:00100000:0.0:1789896019.829943:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003507584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896019.830023:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003507584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.830031:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1915 00000100:00100000:2.0:1789896019.830036:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003507584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.830066:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003507712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.830093:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.830107:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7600 going to sleep for 11 seconds 00000100:00100000:1.0:1789896019.830117:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003507712 00000100:00100000:1.0:1789896019.830122:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003507712 00000100:00100000:1.0:1789896019.830147:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:1.0:1789896019.830155:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003507712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896019.830405:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003507712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 252us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896019.830412:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:2.0:1789896019.830423:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003507712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896019.830601:0:212914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212914:1876838003507840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896019.830640:0:212914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.830656:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003507840 00000100:00100000:0.0:1789896019.830661:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003507840 00000100:00100000:3.0:1789896019.830667:0:212914:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a40f240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.830686:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:0.0:1789896019.830692:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:212914:x1876838003507840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896019.830772:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:212914:x1876838003507840:12345-0@lo:502:llog_process_th.0 Request processed in 79us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.830778:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00100000:3.0:1789896019.830788:0:212914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212914:1876838003507840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789896019.830808:0:212914:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789896019.830816:0:212914:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789896019.830818:0:212914:0:(obd_config.c:1561:class_process_config()) marker 162 (0x1) lustre-MDT0001-m del lustre.qpool1 00000020:00000080:3.0:1789896019.830824:0:212914:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1789896019.830918:0:212914:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212914:1876838003507968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896019.830955:0:212914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896019.830974:0:212914:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94e137480 going to sleep for 11 seconds 00000100:00100000:2.0:1789896019.830974:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003507968 00000100:00100000:2.0:1789896019.830980:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003507968 00000100:00100000:2.0:1789896019.831013:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:2.0:1789896019.831021:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:212914:x1876838003507968:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896019.831098:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:212914:x1876838003507968:12345-0@lo:502:llog_process_th.0 Request processed in 78us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.831105:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00100000:3.0:1789896019.831114:0:212914:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f62680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212914:1876838003507968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789896019.831133:0:212914:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789896019.831136:0:212914:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789896019.831138:0:212914:0:(obd_config.c:1561:class_process_config()) marker 162 (0x2) lustre-MDT0001-m del lustre.qpool1 00000040:00080000:3.0:1789896019.831140:0:212914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 175 count 172 00000020:01000000:2.0:1789896019.831180:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 172-174 (rc=0) 10000000:01000000:2.0:1789896019.831230:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789896019.831237:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.831260:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896019.831269:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896019.831271:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 150 10000000:01000000:2.0:1789896019.831279:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896019.831294:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.831302:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.831310:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896019.831324:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003508096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.831352:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896019.831371:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003508096 00000100:00100000:2.0:1789896019.831374:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.831375:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003508096 00000100:00100000:0.0:1789896019.831402:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1919 00000100:00100000:0.0:1789896019.831408:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003508096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896019.831414:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896019.831422:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a20b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a20ab expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.831435:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a20b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a20ab expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.831441:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a20b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a20ab expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896019.831446:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5ac00, rc 0) 00000100:00100000:0.0:1789896019.831472:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003508096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896019.831477:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1919 00000100:00100000:2.0:1789896019.831484:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003508096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896019.831494:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896019.831500:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a20b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896019.831529:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003508224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.831554:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.831569:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896019.831586:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003508224 00000100:00100000:3.0:1789896019.831590:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003508224 00000100:00100000:3.0:1789896019.831621:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:3.0:1789896019.831629:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003508224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896019.831711:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003508224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.831712:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003508224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896019.831725:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00100000:2.0:1789896019.831737:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003508352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896019.831766:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.831778:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.831791:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003508352 00000100:00100000:0.0:1789896019.831796:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003508352 00000100:00100000:0.0:1789896019.831817:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:0.0:1789896019.831823:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003508352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896019.831895:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003508352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.831898:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003508352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896019.831910:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:2.0:1789896019.832089:0:212916:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212916:1876838003508480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896019.832125:0:212916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896019.832144:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003508480 00000100:00100000:2.0:1789896019.832146:0:212916:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948db2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896019.832149:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003508480 00000100:00100000:3.0:1789896019.832173:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:3.0:1789896019.832178:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:212916:x1876838003508480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896019.832484:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:212916:x1876838003508480:12345-0@lo:502:llog_process_th.0 Request processed in 304us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896019.832490:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00100000:2.0:1789896019.832493:0:212916:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212916:1876838003508480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896019.832523:0:212916:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212916:1876838003508608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896019.832554:0:212916:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896019.832578:0:212916:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948db2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789896019.832589:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003508608 00000100:00100000:0.0:1789896019.832595:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003508608 00000100:00100000:0.0:1789896019.832622:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1923 00000100:00100000:0.0:1789896019.832629:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:212916:x1876838003508608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896019.832703:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:212916:x1876838003508608:12345-0@lo:502:llog_process_th.0 Request processed in 73us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896019.832709:0:212916:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:212916:1876838003508608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896019.832713:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1923 00000040:00080000:2.0:1789896019.832729:0:212916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000020:01000000:3.0:1789896019.832780:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 150-152 (rc=0) 10000000:01000000:3.0:1789896019.832796:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896019.832801:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896019.832808:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896019.949412:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896020.396610:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003508736:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789896020.396686:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896020.396750:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003508736 00000100:00100000:2.0:1789896020.396759:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003508736 00000100:00100000:2.0:1789896020.396827:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789896020.396838:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003508736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789896020.396873:0:188736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789896020.396923:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003508736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896020.396931:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789896020.396974:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003508736:0@lo:41:osp-pre-1-0.0 00000020:00000080:1.0:1789896020.877728:0:213080:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffeac56cfe0 20000000:00000080:1.0:1789896020.877745:0:213080:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91aa654f9800 uarg=0000000000000000 00000040:00100000:1.0:1789896020.878309:0:213080:0:(llog.c:1072:llog_reverse_process()) index 152 : idx 137 20000000:01000000:1.0:1789896020.878316:0:213080:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 142 cmd:0xce021 lustre.qpool2 lustre-OST0001_UUID 20000000:01000000:1.0:1789896020.878332:0:213080:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1789896020.878589:0:213081:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 141 marker 151 1->4: lustre-clilov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:1.0:1789896020.878647:0:213081:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 143 marker 151 2->4: lustre-clilov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:1.0:1789896020.878672:0:213081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 153 count 150 00000040:00080000:3.0:1789896020.879287:0:213080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].153, 224 off36048 20000000:01000000:3.0:1789896020.879306:0:213080:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1789896020.879324:0:213080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].154, 128 off36176 00000040:00080000:3.0:1789896020.879343:0:213080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].155, 224 off36400 20000000:01000000:3.0:1789896020.879358:0:213080:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1789896020.879575:0:213082:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 163 marker 152 1->4: lustre-MDT0000-mdtlov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:1.0:1789896020.879598:0:213082:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 165 marker 152 2->4: lustre-MDT0000-mdtlov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:1.0:1789896020.879618:0:213082:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 175 count 172 00000040:00080000:3.0:1789896020.879716:0:213080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].175, 224 off40216 20000000:01000000:3.0:1789896020.879729:0:213080:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1789896020.879743:0:213080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].176, 136 off40352 00000040:00080000:3.0:1789896020.879771:0:213080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].177, 224 off40576 20000000:01000000:3.0:1789896020.879790:0:213080:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789896020.880005:0:213083:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 163 marker 153 1->4: lustre-MDT0001-mdtlov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:2.0:1789896020.880027:0:213083:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 165 marker 153 2->4: lustre-MDT0001-mdtlov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:2.0:1789896020.880037:0:213083:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 175 count 172 00000040:00080000:3.0:1789896020.880125:0:213080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].175, 224 off40216 20000000:01000000:3.0:1789896020.880135:0:213080:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1789896020.880148:0:213080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].176, 136 off40352 00000040:00080000:3.0:1789896020.880161:0:213080:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].177, 224 off40576 10000000:01000000:3.0:1789896020.880173:0:213080:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789896020.880193:0:213080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880245:0:213080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a202d expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880255:0:213080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2042 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a203b expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880265:0:213080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f58a expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880272:0:213080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f591 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880279:0:213080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a205e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2057 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880286:0:213080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a206c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2065 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880293:0:213080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a207a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2073 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880310:0:213080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a2088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2081 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880317:0:213080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a2096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a208f expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880324:0:213080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a20a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a209d expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880331:0:213080:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a20b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a20ab expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880339:0:213080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880376:0:213080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a20b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a20ab expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880389:0:213080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a20b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a20ab expref: 23 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.880403:0:213080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f62680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003508864:0@lo:104: 00000100:00100000:3.0:1789896020.880461:0:213080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896020.880510:0:213080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a20a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a209d expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.880514:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003508864 00010000:00010000:3.0:1789896020.880520:0:213080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a20a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a209d expref: 23 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.880524:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003508864 00000100:00100000:3.0:1789896020.880544:0:213080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003508992:0@lo:104: 00000100:00100000:3.0:1789896020.880569:0:213080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896020.880585:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003508992 00000100:00100000:0.0:1789896020.880590:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003508992 00000100:00100000:1.0:1789896020.880600:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00010000:00010000:3.0:1789896020.880607:0:213080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a2096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a208f expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896020.880616:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213080:x1876838003508864:12345-0@lo:104: 00000100:00100000:2.0:1789896020.880618:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00010000:00010000:3.0:1789896020.880621:0:213080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a2096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a208f expref: 23 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.880636:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.880637:0:213080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003509120:0@lo:104: 00000100:00100000:2.0:1789896020.880637:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213080:x1876838003508992:12345-0@lo:104: 00010000:00010000:2.0:1789896020.880654:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.880669:0:213080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896020.880710:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003509120 00010000:00010000:3.0:1789896020.880711:0:213080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a2088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2081 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.880715:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003509120 00010000:00010000:1.0:1789896020.880720:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789896020.880723:0:213080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a2088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2081 expref: 23 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896020.880727:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789896020.880737:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:213080:x1876838003508992:12345-0@lo:104: Request processed in 108us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896020.880739:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:213080:x1876838003508864:12345-0@lo:104: Request processed in 127us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896020.880741:0:213080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003509248:0@lo:104: 00000100:00100000:0.0:1789896020.880748:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1789896020.880757:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1789896020.880762:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:213080:x1876838003509120:12345-0@lo:104: 00000100:00100000:1.0:1789896020.880765:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1789896020.880776:0:213080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896020.880777:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2096 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896020.880788:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003509248 00000100:00100000:1.0:1789896020.880795:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003509248 00010000:00010000:3.0:1789896020.880806:0:213080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a207a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2073 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.880816:0:213080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a207a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2073 expref: 23 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.880829:0:213080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003509376:0@lo:104: 00000100:00100000:1.0:1789896020.880829:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00010000:00010000:0.0:1789896020.880832:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789896020.880845:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213080:x1876838003509120:12345-0@lo:104: Request processed in 84us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896020.880846:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213080:x1876838003509248:12345-0@lo:104: 00000100:00100000:3.0:1789896020.880859:0:213080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896020.880862:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2088 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.880863:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:2.0:1789896020.880883:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003509376 00000100:00100000:2.0:1789896020.880889:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003509376 00010000:00010000:3.0:1789896020.880891:0:213080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a206c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2065 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.880897:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789896020.880905:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.880915:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1789896020.880917:0:213080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a206c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2065 expref: 23 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.880917:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00010000:00010000:0.0:1789896020.880919:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8200 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896020.880928:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a20b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896020.880929:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213080:x1876838003509248:12345-0@lo:104: Request processed in 87us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896020.880930:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213080:x1876838003509376:12345-0@lo:104: 00010000:00010000:2.0:1789896020.880943:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a207a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.880945:0:213080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f62300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003509504:0@lo:104: 00000100:00100000:1.0:1789896020.880947:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00010000:00010000:0.0:1789896020.880969:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a20b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.880972:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789896020.880981:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896020.880982:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a20b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896020.880996:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789896020.881002:0:213080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896020.881004:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2200 already unused, calling callback (ffffffffc1214c20) 10000000:01000000:0.0:1789896020.881004:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789896020.881010:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f62a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213080:x1876838003509376:12345-0@lo:104: Request processed in 79us (150us total) trans 0 rc 0/0 10000000:00010000:1.0:1789896020.881012:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a20a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881025:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00010000:00010000:1.0:1789896020.881031:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a20a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.881032:0:213080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a205e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2057 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881042:0:188714:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789896020.881045:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896020.881053:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a20a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881056:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003509504 00010000:00010000:3.0:1789896020.881057:0:213080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a205e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2057 expref: 23 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881062:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003509504 00010000:00010000:0.0:1789896020.881064:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:1.0:1789896020.881074:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789896020.881076:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1789896020.881084:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f1b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213080:x1876838003509504:12345-0@lo:104: 00000100:00100000:3.0:1789896020.881089:0:213080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b41880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003509632:0@lo:104: 00010000:00010000:0.0:1789896020.881091:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896020.881094:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a206c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881103:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.881113:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a20ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20b2 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.881118:0:213080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896020.881124:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896020.881138:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789896020.881143:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2096 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.881148:0:213080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f591 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896020.881148:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789896020.881153:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.881157:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9800 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:2.0:1789896020.881158:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f1b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213080:x1876838003509504:12345-0@lo:104: Request processed in 73us (159us total) trans 0 rc 0/0 10000000:00010000:0.0:1789896020.881165:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2096 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881177:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00010000:00010000:3.0:1789896020.881178:0:213080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f591 expref: 9 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881179:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a209d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20a4 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.881188:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2096 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881241:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003509632 00010000:00010000:1.0:1789896020.881243:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 10000000:00010000:0.0:1789896020.881244:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2096 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.881245:0:213080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003510016:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789896020.881246:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003509632 00010000:00010000:1.0:1789896020.881249:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2088 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881265:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00010000:00010000:1.0:1789896020.881269:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8400 already unused, calling callback (ffffffffc1214c20) 10000000:01000000:0.0:1789896020.881272:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1789896020.881274:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2088 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881276:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213080:x1876838003509632:12345-0@lo:104: 00010000:00010000:2.0:1789896020.881287:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a205e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881289:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2088 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.881295:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2096 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896020.881312:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2088 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.881312:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896020.881320:0:213080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f58a expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896020.881324:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896020.881325:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1789896020.881325:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2096 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881339:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213080:x1876838003509632:12345-0@lo:104: Request processed in 61us (220us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896020.881342:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a208f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2096 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.881343:0:213080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f58a expref: 9 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881347:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2088 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881356:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00010000:00010000:1.0:1789896020.881369:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896020.881372:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:3.0:1789896020.881375:0:213080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b43b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003510272:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789896020.881378:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a207a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881380:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2088 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.881398:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a200 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896020.881402:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a207a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881419:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8400/0x412fd4b3617a2081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2088 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.881422:0:213080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a203b expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.881422:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a207a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881439:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:0.0:1789896020.881443:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a207a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881446:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a206c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.881447:0:213080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a203b expref: 23 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896020.881464:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896020.881467:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9200 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896020.881473:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a206c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.881477:0:213080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003510528:0@lo:104: 00010000:00010000:0.0:1789896020.881485:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a207a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881487:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a206c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.881501:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789896020.881504:0:213080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789896020.881505:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a206c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896020.881515:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896020.881518:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a207a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.881527:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a2073 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a207a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881537:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a206c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.881539:0:213080:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a202d expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881541:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003510528 00010000:00010000:0.0:1789896020.881541:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789896020.881548:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003510528 00010000:00010000:0.0:1789896020.881549:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a205e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881556:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896020.881565:0:213080:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2034 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a202d expref: 23 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881568:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a206c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.881568:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3000 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:2.0:1789896020.881575:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 10000000:00010000:0.0:1789896020.881576:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a205e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.881589:0:213080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003510912:0@lo:104: 00000100:00100000:2.0:1789896020.881590:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213080:x1876838003510528:12345-0@lo:104: 00010000:00010000:1.0:1789896020.881590:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9200/0x412fd4b3617a2065 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a206c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.881595:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a205e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896020.881605:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2042 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896020.881617:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a205e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881620:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896020.881622:0:213080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896020.881631:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789896020.881631:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896020.881636:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896020.881639:0:213080:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0480 going to sleep for 11 seconds 00010000:00010000:1.0:1789896020.881649:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896020.881653:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a205e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.881658:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896020.881662:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789896020.881664:0:213080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f62680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003508864:0@lo:104: 00010000:00010000:2.0:1789896020.881666:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789896020.881671:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a205e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881677:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213080:x1876838003510528:12345-0@lo:104: Request processed in 91us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896020.881679:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003510144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896020.881683:0:213080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003508992:0@lo:104: 00010000:00010000:0.0:1789896020.881690:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3000/0x412fd4b3617a2057 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a205e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881693:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:3.0:1789896020.881700:0:213080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003509120:0@lo:104: 00000100:00100000:2.0:1789896020.881711:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003510912 00000100:00100000:3.0:1789896020.881716:0:213080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003509248:0@lo:104: 00000100:00100000:2.0:1789896020.881717:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003510912 00010000:00010000:0.0:1789896020.881720:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896020.881726:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2042 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896020.881730:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896020.881732:0:213080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003509376:0@lo:104: 00000100:00100000:2.0:1789896020.881741:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00010000:00010000:0.0:1789896020.881746:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9e00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896020.881751:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2042 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881753:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213080:x1876838003510912:12345-0@lo:104: 00000100:00100000:3.0:1789896020.881754:0:213080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f62300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003509504:0@lo:104: 00000100:00100000:1.0:1789896020.881764:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003511040:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896020.881769:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.881771:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2042 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.881773:0:213080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b41880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003509632:0@lo:104: 10000000:00010000:0.0:1789896020.881789:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2042 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.881791:0:213080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003510528:0@lo:104: 00000100:00100000:1.0:1789896020.881799:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789896020.881812:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896020.881830:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00010000:00010000:0.0:1789896020.881833:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2042 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.881841:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003510400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896020.881842:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003509888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896020.881843:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896020.881855:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2042 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896020.881858:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789896020.881869:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213080:x1876838003510912:12345-0@lo:104: Request processed in 118us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896020.881877:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00010000:00010000:0.0:1789896020.881881:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9e00/0x412fd4b3617a203b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2042 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896020.881890:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896020.881893:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003509760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896020.881902:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896020.881907:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.881921:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003510144 00000100:00100000:2.0:1789896020.881927:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003510144 00000100:00100000:3.0:1789896020.881928:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896020.881929:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9c00 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:1.0:1789896020.881931:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003510784:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1789896020.881937:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896020.881948:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a2096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a208f expref: 24 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.881948:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.881958:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003510656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896020.881969:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1789896020.881973:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896020.881980:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789896020.881985:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003511040 00000100:00100000:2.0:1789896020.881990:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003511040 00000100:00100000:3.0:1789896020.881995:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896020.882002:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896020.882010:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a205e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2057 expref: 25 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.882011:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789896020.882014:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1789896020.882023:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.882027:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003511296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896020.882032:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003509888 00000100:00100000:2.0:1789896020.882038:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003509888 00010000:00010000:0.0:1789896020.882040:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a202d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2034 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896020.882055:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a20a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a209d expref: 26 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.882058:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896020.882063:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896020.882065:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896020.882067:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896020.882078:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003509760 00000100:00100000:2.0:1789896020.882083:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003509760 00000100:00100000:3.0:1789896020.882084:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003511168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896020.882089:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003510784 00000100:00100000:0.0:1789896020.882095:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003510784 00010000:00010000:2.0:1789896020.882102:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a20b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a20ab expref: 28 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896020.882109:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003510656 00000100:00100000:1.0:1789896020.882115:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003510656 00000100:00100000:3.0:1789896020.882116:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896020.882118:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003511296 00010000:00010000:0.0:1789896020.882119:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a206c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2065 expref: 28 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.882123:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003511296 00010000:00010000:1.0:1789896020.882136:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a207a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2073 expref: 30 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896020.882142:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2034 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a202d expref: 30 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.882144:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003511168 00000100:00100000:0.0:1789896020.882155:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003511168 00010000:00010000:3.0:1789896020.882157:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896020.882165:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1789896020.882172:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00010000:00010000:0.0:1789896020.882176:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a203b expref: 31 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896020.882177:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+31:3616:x1876838003510144:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896020.882194:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+31:3616:x1876838003511040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896020.882194:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896020.882224:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896020.882239:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a2096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a208f expref: 31 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896020.882244:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a205e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2057 expref: 31 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.882250:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00010000:00010000:1.0:1789896020.882260:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a2096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a208f expref: 31 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.882267:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+31:3616:x1876838003509888:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896020.882268:0:213080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b43480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003510912:0@lo:104: 00010000:00010000:2.0:1789896020.882277:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a205e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2057 expref: 31 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.882284:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896020.882294:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a2096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a208f expref: 31 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.882294:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a20a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a209d expref: 31 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896020.882295:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a205e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2057 expref: 31 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.882299:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896020.882316:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00010000:00010000:2.0:1789896020.882318:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896020.882324:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a20a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a209d expref: 30 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.882332:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+29:3618:x1876838003509760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896020.882335:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896020.882344:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896020.882344:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c7c00/0x412fd4b3617a20a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a209d expref: 29 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.882354:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a20b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a20ab expref: 29 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.882360:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3616:x1876838003511040:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (564us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896020.882361:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896020.882373:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3616:x1876838003510144:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (644us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896020.882375:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a20b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a20ab expref: 28 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.882375:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1789896020.882391:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00010000:00010000:3.0:1789896020.882396:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a20b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a20ab expref: 27 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.882406:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789896020.882407:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3616:x1876838003509888:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (517us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896020.882413:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896020.882416:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1789896020.882418:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3616:x1876838003510784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896020.882429:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789896020.882431:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:1.0:1789896020.882432:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003510656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896020.882438:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a206c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2065 expref: 25 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.882445:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896020.882450:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a206c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2065 expref: 24 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.882453:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3618:x1876838003509760:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (526us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896020.882454:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a207a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2073 expref: 24 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.882459:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00010000:00010000:2.0:1789896020.882471:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a206c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2065 expref: 24 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.882477:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3618:x1876838003511296:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896020.882478:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00010000:00010000:1.0:1789896020.882481:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a207a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2073 expref: 24 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.882495:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896020.882501:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896020.882503:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a207a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2073 expref: 22 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.882504:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2034 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a202d expref: 22 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.882526:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a202d expref: 21 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.882534:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3616:x1876838003510784:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (567us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896020.882537:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896020.882544:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2034 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a202d expref: 21 pid: 188725 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.882550:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00010000:00010000:0.0:1789896020.882567:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896020.882569:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:1.0:1789896020.882576:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3618:x1876838003510656:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896020.882583:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3618:x1876838003511168:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896020.882588:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00010000:00010000:3.0:1789896020.882595:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896020.882602:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2042 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a203b expref: 18 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.882606:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3618:x1876838003511296:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (544us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896020.882619:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2042 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a203b expref: 18 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.882621:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1789896020.882628:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896020.882640:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2042 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a203b expref: 17 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.882642:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003510400 00000100:00100000:0.0:1789896020.882648:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003510400 00010000:00010000:3.0:1789896020.882654:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896020.882676:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a2088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2081 expref: 17 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896020.882691:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003509888:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896020.882692:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:3618:x1876838003511168:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896020.882707:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1789896020.882714:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003510784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896020.882715:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:0.0:1789896020.882721:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a53450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:3617:x1876838003510400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896020.882732:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896020.882734:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003510144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896020.882739:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a2088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2081 expref: 16 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896020.882749:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003511040:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896020.882753:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a2088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2081 expref: 16 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.882758:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003511296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896020.882778:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003511168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896020.882778:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c7a00/0x412fd4b3617a2088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2081 expref: 16 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896020.882795:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003509760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896020.882795:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896020.882807:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003510656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896020.882835:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896020.882840:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a53450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3617:x1876838003510400:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896020.882849:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:2.0:1789896020.882857:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003510400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896020.883076:0:213080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b43b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003510272:192.168.202.44@tcp:104: 00000100:00100000:3.0:1789896020.883088:0:213080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213080:1876838003510016:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789896020.883116:0:213080:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896020.884278:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896020.884306:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015946496 00000100:00100000:2.0:1789896020.884312:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015946496 00000100:00100000:1.0:1789896020.884313:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:2.0:1789896020.884340:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f591 expref: 10 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.884355:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015946368 00000100:00100000:0.0:1789896020.884361:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015946368 00000100:00100000:2.0:1789896020.884373:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 458 00010000:00010000:0.0:1789896020.884380:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f58a expref: 11 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.884385:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015946496:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789896020.884399:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896020.884405:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f591 expref: 11 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896020.884417:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f591 expref: 11 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.884425:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 459 00010000:00010000:2.0:1789896020.884434:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b400/0x412fd4b3617a2050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f591 expref: 11 pid: 188726 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.884439:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015946368:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789896020.884445:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896020.884450:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896020.884457:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2049 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f58a expref: 10 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.884468:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f58a expref: 10 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.884480:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a2049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f58a expref: 10 pid: 188723 timeout: 3993 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.884487:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:a6f6720b-db77-464e-82b6-5f314c431303+10:2403:x1876838015946496:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 103us (208us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896020.884496:0:188717:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896020.884497:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 458 00010000:00010000:0.0:1789896020.884509:0:188717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.884524:0:188717:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.884532:0:188717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.884539:0:188717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.884546:0:188717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.884562:0:188717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3600 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:0.0:1789896020.884566:0:188717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.884573:0:188717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.884587:0:188717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896020.884598:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896020.884625:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f6720b-db77-464e-82b6-5f314c431303+8:2404:x1876838015946368:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 191us (311us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896020.884631:0:213080:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896020.884634:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 459 00010000:00010000:3.0:1789896020.884645:0:213080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896020.884652:0:213080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a20b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896020.972496:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896021.420453:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003511424:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789896021.420550:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896021.420591:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003511552:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789896021.420606:0:188735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003511424 00000100:00100000:1.0:1789896021.420620:0:188735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003511424 00000100:00100000:2.0:1789896021.420651:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896021.420688:0:188735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789896021.420706:0:188735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003511424:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789896021.420714:0:203484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003511552 00000100:00100000:0.0:1789896021.420724:0:203484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003511552 00000004:00000024:1.0:1789896021.420743:0:188735:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00080000:3.0:1789896021.420781:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789896021.420800:0:203484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789896021.420812:0:203484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003511552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789896021.420841:0:203484:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789896021.420843:0:188735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003511424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896021.420856:0:188735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789896021.420885:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003511424:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789896021.420905:0:203484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003511552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896021.420913:0:203484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789896021.420926:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003511552:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789896021.996461:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789896022.380303:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789896022.380308:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 153 10000000:01000000:3.0:1789896022.380312:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789896022.380356:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.380365:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.380373:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896022.380393:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003511680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.380448:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.380494:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0480 going to sleep for 11 seconds 00000100:00100000:2.0:1789896022.380524:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003511680 00000100:00100000:2.0:1789896022.380533:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003511680 00000100:00100000:2.0:1789896022.380591:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:2.0:1789896022.380601:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003511680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896022.380614:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896022.380629:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a20c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a20c0 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.380659:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a20c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a20c0 expref: 16 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.380671:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a20c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a20c0 expref: 16 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.380689:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9400, rc 0) 00000100:00100000:2.0:1789896022.380732:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003511680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896022.380740:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00100000:3.0:1789896022.380775:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003511680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896022.380804:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20c7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.380823:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a20c7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896022.380888:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003511808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.380924:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.380950:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0480 going to sleep for 11 seconds 00000100:00100000:0.0:1789896022.381016:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003511808 00000100:00100000:0.0:1789896022.381021:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003511808 00000100:00100000:0.0:1789896022.381056:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:0.0:1789896022.381065:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003511808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.381271:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003511808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 207us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896022.381278:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00100000:3.0:1789896022.381334:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003511808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.381362:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003511936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.381398:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.381420:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0480 going to sleep for 11 seconds 00000100:00100000:2.0:1789896022.381444:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003511936 00000100:00100000:2.0:1789896022.381449:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003511936 00000100:00100000:2.0:1789896022.381476:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:2.0:1789896022.381484:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003511936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896022.381573:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003511936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896022.381581:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00100000:3.0:1789896022.381607:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003511936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.381874:0:213084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213084:1876838003512064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896022.381908:0:213084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.381925:0:213084:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0180 going to sleep for 11 seconds 00000100:00100000:0.0:1789896022.381945:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003512064 00000100:00100000:0.0:1789896022.381950:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003512064 00000100:00100000:0.0:1789896022.381970:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1927 00000100:00100000:0.0:1789896022.381974:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:213084:x1876838003512064:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896022.382044:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:213084:x1876838003512064:12345-0@lo:502:llog_process_th.0 Request processed in 69us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896022.382051:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1927 00000100:00100000:3.0:1789896022.382071:0:213084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213084:1876838003512064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896022.382104:0:213084:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213084:1876838003512192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896022.382126:0:213084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.382142:0:213084:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0180 going to sleep for 11 seconds 00000100:00100000:2.0:1789896022.382167:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003512192 00000100:00100000:2.0:1789896022.382172:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003512192 00000100:00100000:1.0:1789896022.382237:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:1.0:1789896022.382252:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:213084:x1876838003512192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896022.382335:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:213084:x1876838003512192:12345-0@lo:502:llog_process_th.0 Request processed in 89us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896022.382343:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1789896022.382364:0:213084:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213084:1876838003512192:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789896022.382384:0:213084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000020:01000000:0.0:1789896022.382469:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 153-155 (rc=0) 10000000:01000000:0.0:1789896022.382495:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896022.382501:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20c7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.382508:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20c7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896022.382514:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789896022.382515:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:0.0:1789896022.382517:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789896022.382530:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.382540:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.382545:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896022.382558:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003512320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.382577:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.382594:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896022.382604:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003512320 00000100:00100000:3.0:1789896022.382608:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003512320 00000100:00100000:3.0:1789896022.382629:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:3.0:1789896022.382633:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003512320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896022.382638:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896022.382646:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a20d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a20ce expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.382657:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a20d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a20ce expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.382663:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a20d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a20ce expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.382668:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2600, rc 0) 00000100:00100000:3.0:1789896022.382692:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003512320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 59us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.382696:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:0.0:1789896022.382717:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003512320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896022.382725:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20d5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.382731:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a20d5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896022.382758:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003512448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.382773:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.382787:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789896022.382816:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003512448 00000100:00100000:1.0:1789896022.382821:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003512448 00000100:00100000:1.0:1789896022.382850:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:1.0:1789896022.382859:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003512448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896022.382945:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003512448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896022.382959:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00100000:0.0:1789896022.382978:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003512448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.382998:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003512576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.383021:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.383034:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896022.383054:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003512576 00000100:00100000:3.0:1789896022.383059:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003512576 00000100:00100000:3.0:1789896022.383089:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1931 00000100:00100000:3.0:1789896022.383096:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003512576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.383181:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003512576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.383188:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1931 00000100:00100000:0.0:1789896022.383240:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003512576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789896022.383876:0:213085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:3.0:1789896022.383972:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:3.0:1789896022.383988:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789896022.383994:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20d5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.384009:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20d5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896022.384016:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789896022.384018:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 153 10000000:01000000:3.0:1789896022.384020:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789896022.384033:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.384041:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.384049:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896022.384061:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003512704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.384083:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.384102:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789896022.384129:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003512704 00000100:00100000:1.0:1789896022.384134:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003512704 00000100:00100000:1.0:1789896022.384168:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:1.0:1789896022.384174:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003512704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896022.384182:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789896022.384192:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a20e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a20dc expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896022.384253:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a20e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a20dc expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896022.384264:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a20e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a20dc expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896022.384272:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9523c7600, rc 0) 00000100:00100000:1.0:1789896022.384304:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003512704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896022.384311:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:3.0:1789896022.384321:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003512704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896022.384331:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20e3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.384337:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a20e3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896022.384365:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003512832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.384382:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.384411:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896022.384432:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003512832 00000100:00100000:0.0:1789896022.384438:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003512832 00000100:00100000:0.0:1789896022.384468:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:0.0:1789896022.384475:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003512832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.384535:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003512832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896022.384547:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00100000:3.0:1789896022.384561:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003512832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.384582:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003512960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.384608:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.384621:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789896022.384645:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003512960 00000100:00100000:1.0:1789896022.384651:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003512960 00000100:00100000:1.0:1789896022.384676:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:1.0:1789896022.384683:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003512960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896022.384745:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003512960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896022.384752:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00100000:3.0:1789896022.384762:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003512960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.384987:0:213086:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213086:1876838003513088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896022.385016:0:213086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.385029:0:213086:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0300 going to sleep for 11 seconds 00000100:00100000:0.0:1789896022.385046:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003513088 00000100:00100000:0.0:1789896022.385051:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003513088 00000100:00100000:0.0:1789896022.385073:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1935 00000100:00100000:0.0:1789896022.385078:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:213086:x1876838003513088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896022.385135:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:213086:x1876838003513088:12345-0@lo:502:llog_process_th.0 Request processed in 57us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896022.385141:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1935 00000100:00100000:3.0:1789896022.385154:0:213086:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213086:1876838003513088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896022.385186:0:213086:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213086:1876838003513216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896022.385240:0:213086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.385268:0:213086:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789896022.385320:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003513216 00000100:00100000:1.0:1789896022.385324:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003513216 00000100:00100000:1.0:1789896022.385347:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:1.0:1789896022.385352:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:213086:x1876838003513216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896022.385442:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:213086:x1876838003513216:12345-0@lo:502:llog_process_th.0 Request processed in 88us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896022.385455:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00100000:3.0:1789896022.385511:0:213086:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213086:1876838003513216:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789896022.385528:0:213086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000020:01000000:0.0:1789896022.385581:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 153-155 (rc=0) 10000000:01000000:0.0:1789896022.385600:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896022.385605:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20e3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.385611:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20e3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896022.385616:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789896022.385617:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:0.0:1789896022.385619:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789896022.385636:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.385641:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.385646:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896022.385654:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003513344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.385677:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.385690:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896022.385700:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003513344 00000100:00100000:3.0:1789896022.385706:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003513344 00000100:00100000:3.0:1789896022.385732:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:3.0:1789896022.385739:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003513344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896022.385746:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896022.385755:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a20f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a20ea expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.385771:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a20f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a20ea expref: 19 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.385788:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a20f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a20ea expref: 19 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.385795:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2200, rc 0) 00000100:00100000:3.0:1789896022.385828:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003513344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.385833:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00100000:0.0:1789896022.385865:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003513344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896022.385877:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20f1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.385886:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a20f1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896022.385934:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003513472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.385959:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.385979:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896022.386002:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003513472 00000100:00100000:1.0:1789896022.386007:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003513472 00000100:00100000:1.0:1789896022.386034:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:1.0:1789896022.386041:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003513472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896022.386112:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003513472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896022.386119:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00100000:0.0:1789896022.386136:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003513472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.386170:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003513600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.386241:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.386264:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003513600 00000100:00100000:0.0:1789896022.386268:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896022.386270:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003513600 00000100:00100000:3.0:1789896022.386301:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1939 00000100:00100000:3.0:1789896022.386307:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003513600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.386375:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003513600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.386384:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1939 00000100:00100000:0.0:1789896022.386384:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003513600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789896022.387087:0:213087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:0.0:1789896022.387151:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:0.0:1789896022.387170:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789896022.387176:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20f1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.387185:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20f1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896022.387192:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896022.387225:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 153 10000000:01000000:0.0:1789896022.387228:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896022.387244:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.387251:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.387258:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896022.387271:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003513728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.387300:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896022.387330:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003513728 00000100:00100000:0.0:1789896022.387332:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789896022.387337:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003513728 00000100:00100000:2.0:1789896022.387455:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:2.0:1789896022.387466:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003513728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896022.387474:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896022.387483:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a20ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a20f8 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.387499:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a20ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a20f8 expref: 20 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.387508:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a20ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a20f8 expref: 20 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.387532:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9a00, rc 0) 00000100:00100000:2.0:1789896022.387565:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003513728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896022.387571:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00100000:0.0:1789896022.387596:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003513728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896022.387608:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20ff expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.387617:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a20ff expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896022.387653:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003513856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.387675:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.387694:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896022.387695:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003513856 00000100:00100000:3.0:1789896022.387700:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003513856 00000100:00100000:3.0:1789896022.387721:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:3.0:1789896022.387725:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003513856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.387778:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003513856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.387783:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:0.0:1789896022.387808:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003513856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.387832:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003513984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.387866:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.387892:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896022.387923:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003513984 00000100:00100000:2.0:1789896022.387928:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003513984 00000100:00100000:2.0:1789896022.387955:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942 00000100:00100000:2.0:1789896022.387962:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003513984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896022.388039:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003513984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896022.388046:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942 00000100:00100000:0.0:1789896022.388072:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003513984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896022.388300:0:213088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213088:1876838003514112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896022.388333:0:213088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896022.388356:0:213088:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a95215c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789896022.388367:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003514112 00000100:00100000:3.0:1789896022.388373:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003514112 00000100:00100000:3.0:1789896022.388401:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1943 00000100:00100000:3.0:1789896022.388407:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:213088:x1876838003514112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896022.388490:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:213088:x1876838003514112:12345-0@lo:502:llog_process_th.0 Request processed in 83us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.388498:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1943 00000100:00100000:2.0:1789896022.388520:0:213088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213088:1876838003514112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896022.388561:0:213088:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213088:1876838003514240:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896022.388590:0:213088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896022.388607:0:213088:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94a4efa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896022.388611:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003514240 00000100:00100000:3.0:1789896022.388616:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003514240 00000100:00100000:3.0:1789896022.388645:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:3.0:1789896022.388650:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:213088:x1876838003514240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896022.388712:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:213088:x1876838003514240:12345-0@lo:502:llog_process_th.0 Request processed in 61us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.388718:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:2.0:1789896022.388779:0:213088:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213088:1876838003514240:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896022.388798:0:213088:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000020:01000000:0.0:1789896022.388858:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 153-155 (rc=0) 10000000:01000000:0.0:1789896022.388877:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896022.388882:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20ff expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.388890:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a20ff expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896022.388898:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789896022.388899:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 175 10000000:01000000:0.0:1789896022.388901:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789896022.388914:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.388921:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.388929:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896022.388940:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003514368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.388964:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.388979:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896022.388997:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003514368 00000100:00100000:3.0:1789896022.389002:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003514368 00000100:00100000:3.0:1789896022.389031:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:3.0:1789896022.389038:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003514368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896022.389055:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896022.389065:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a210d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2106 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.389081:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a210d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2106 expref: 21 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.389090:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a210d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2106 expref: 21 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.389098:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3000, rc 0) 00000100:00100000:3.0:1789896022.389134:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003514368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896022.389150:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003514368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.389152:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00010000:00010000:0.0:1789896022.389168:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a210d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.389188:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a210d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896022.389269:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003514496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.389293:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.389315:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896022.389327:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003514496 00000100:00100000:3.0:1789896022.389333:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003514496 00000100:00100000:3.0:1789896022.389359:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946 00000100:00100000:3.0:1789896022.389366:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003514496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.389437:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003514496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.389444:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946 00000100:00100000:0.0:1789896022.389463:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003514496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.389488:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003514624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.389521:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.389539:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896022.389545:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003514624 00000100:00100000:3.0:1789896022.389550:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003514624 00000100:00100000:3.0:1789896022.389576:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1947 00000100:00100000:3.0:1789896022.389582:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003514624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.389649:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003514624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.389657:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1947 00000100:00100000:0.0:1789896022.389667:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003514624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.389874:0:213089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213089:1876838003514752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896022.389921:0:213089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.389941:0:213089:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5044d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896022.389961:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003514752 00000100:00100000:2.0:1789896022.389967:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003514752 00000100:00100000:2.0:1789896022.389997:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:2.0:1789896022.390005:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:213089:x1876838003514752:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896022.390085:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:213089:x1876838003514752:12345-0@lo:502:llog_process_th.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896022.390093:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:3.0:1789896022.390102:0:213089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213089:1876838003514752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789896022.390130:0:213089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789896022.390139:0:213089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789896022.390141:0:213089:0:(obd_config.c:1561:class_process_config()) marker 165 (0x1) lustre-MDT0001-m rem lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:3.0:1789896022.390146:0:213089:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1789896022.390163:0:213089:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool2 00000100:00100000:3.0:1789896022.390181:0:213089:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213089:1876838003514880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896022.390259:0:213089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.390281:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003514880 00000100:00100000:3.0:1789896022.390285:0:213089:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896022.390286:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003514880 00000100:00100000:0.0:1789896022.390310:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:0.0:1789896022.390316:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:213089:x1876838003514880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896022.390373:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:213089:x1876838003514880:12345-0@lo:502:llog_process_th.0 Request processed in 57us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896022.390379:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:3.0:1789896022.390388:0:213089:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213089:1876838003514880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789896022.390406:0:213089:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789896022.390409:0:213089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789896022.390410:0:213089:0:(obd_config.c:1561:class_process_config()) marker 165 (0x2) lustre-MDT0001-m rem lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:3.0:1789896022.390413:0:213089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 178 count 175 00000020:01000000:0.0:1789896022.390444:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 175-177 (rc=0) 10000000:01000000:0.0:1789896022.390463:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789896022.390468:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a210d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.390474:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a210d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896022.390484:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896022.390485:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 153 10000000:01000000:0.0:1789896022.390487:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896022.390496:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.390501:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.390505:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896022.390513:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003515008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.390530:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.390542:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896022.390564:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003515008 00000100:00100000:2.0:1789896022.390569:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003515008 00000100:00100000:2.0:1789896022.390593:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:2.0:1789896022.390599:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003515008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896022.390606:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896022.390615:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a211b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2114 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.390629:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a211b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2114 expref: 22 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.390638:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a211b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2114 expref: 22 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.390646:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8000, rc 0) 00000100:00100000:2.0:1789896022.390689:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003515008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896022.390697:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:0.0:1789896022.390706:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003515008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896022.390717:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a211b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.390725:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a211b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896022.390759:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003515136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.390785:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.390804:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f253c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896022.390825:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003515136 00000100:00100000:3.0:1789896022.390830:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003515136 00000100:00100000:3.0:1789896022.390854:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1951 00000100:00100000:3.0:1789896022.390861:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003515136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.390918:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003515136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.390925:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1951 00000100:00100000:0.0:1789896022.390935:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003515136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.390969:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003515264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.391001:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.391019:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f253c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896022.391042:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003515264 00000100:00100000:2.0:1789896022.391048:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003515264 00000100:00100000:2.0:1789896022.391075:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:2.0:1789896022.391082:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003515264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896022.391149:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003515264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896022.391164:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003515264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896022.391175:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:0.0:1789896022.391415:0:213090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213090:1876838003515392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896022.391449:0:213090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.391471:0:213090:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f253c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896022.391483:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003515392 00000100:00100000:3.0:1789896022.391489:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003515392 00000100:00100000:3.0:1789896022.391515:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00100000:3.0:1789896022.391523:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:213090:x1876838003515392:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896022.391595:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:213090:x1876838003515392:12345-0@lo:502:llog_process_th.0 Request processed in 73us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.391602:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00100000:0.0:1789896022.391611:0:213090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213090:1876838003515392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896022.391646:0:213090:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213090:1876838003515520:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896022.391669:0:213090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.391683:0:213090:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45121f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896022.391706:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003515520 00000100:00100000:2.0:1789896022.391712:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003515520 00000100:00100000:2.0:1789896022.391738:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00100000:2.0:1789896022.391746:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:213090:x1876838003515520:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896022.391823:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:213090:x1876838003515520:12345-0@lo:502:llog_process_th.0 Request processed in 70us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896022.391829:0:213090:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213090:1876838003515520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896022.391834:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000040:00080000:0.0:1789896022.391855:0:213090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000020:01000000:3.0:1789896022.391917:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 153-155 (rc=0) 10000000:01000000:3.0:1789896022.391937:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896022.391942:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a211b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.391951:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a211b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896022.391965:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789896022.391967:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 175 10000000:01000000:3.0:1789896022.391969:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789896022.391983:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.391990:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.391998:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896022.392011:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003515648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.392038:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.392055:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa467f0300 going to sleep for 11 seconds 00000100:00100000:0.0:1789896022.392064:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003515648 00000100:00100000:0.0:1789896022.392069:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003515648 00000100:00100000:0.0:1789896022.392097:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1955 00000100:00100000:0.0:1789896022.392105:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003515648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896022.392112:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896022.392121:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2122 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.392134:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2122 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.392142:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2122 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.392155:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b600, rc 0) 00000100:00100000:0.0:1789896022.392190:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003515648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896022.392196:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1955 00000100:00100000:3.0:1789896022.392247:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003515648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896022.392258:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2129 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.392267:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2129 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896022.392304:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003515776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.392335:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.392360:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa467f0300 going to sleep for 11 seconds 00000100:00100000:2.0:1789896022.392367:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003515776 00000100:00100000:2.0:1789896022.392372:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003515776 00000100:00100000:2.0:1789896022.392397:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:2.0:1789896022.392404:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003515776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896022.392477:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003515776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896022.392486:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:3.0:1789896022.392492:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003515776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.392522:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003515904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.392549:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.392564:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa467f0300 going to sleep for 11 seconds 00000100:00100000:0.0:1789896022.392581:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003515904 00000100:00100000:0.0:1789896022.392586:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003515904 00000100:00100000:0.0:1789896022.392607:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:0.0:1789896022.392611:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003515904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.392665:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003515904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 53us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896022.392671:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00100000:3.0:1789896022.392679:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003515904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.392851:0:213091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213091:1876838003516032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896022.392880:0:213091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896022.392896:0:213091:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa467f0240 going to sleep for 11 seconds 00000100:00100000:2.0:1789896022.392923:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003516032 00000100:00100000:2.0:1789896022.392928:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003516032 00000100:00100000:2.0:1789896022.392953:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:2.0:1789896022.392965:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:213091:x1876838003516032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896022.393039:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:213091:x1876838003516032:12345-0@lo:502:llog_process_th.0 Request processed in 74us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896022.393047:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00100000:3.0:1789896022.393055:0:213091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213091:1876838003516032:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789896022.393075:0:213091:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789896022.393081:0:213091:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789896022.393083:0:213091:0:(obd_config.c:1561:class_process_config()) marker 164 (0x1) lustre-MDT0000-m rem lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:3.0:1789896022.393087:0:213091:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1789896022.393095:0:213091:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool2 00000020:01000004:3.0:1789896022.393425:0:213092:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a952404000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789896022.393428:0:213092:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a952404000 4 00000100:00100000:1.0:1789896022.393446:0:213091:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213091:1876838003516160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896022.393486:0:213091:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896022.393511:0:213091:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947c6e240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896022.393523:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003516160 00000100:00100000:0.0:1789896022.393529:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003516160 00000100:00100000:0.0:1789896022.393553:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1959 00000100:00100000:0.0:1789896022.393560:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:213091:x1876838003516160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896022.393626:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:213091:x1876838003516160:12345-0@lo:502:llog_process_th.0 Request processed in 66us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896022.393635:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1959 00000100:00100000:1.0:1789896022.393647:0:213091:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213091:1876838003516160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896022.393669:0:213091:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896022.393674:0:213091:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896022.393676:0:213091:0:(obd_config.c:1561:class_process_config()) marker 164 (0x2) lustre-MDT0000-m rem lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:1.0:1789896022.393679:0:213091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 178 count 175 00000020:01000000:0.0:1789896022.393737:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 175-177 (rc=0) 10000000:01000000:0.0:1789896022.393753:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789896022.393760:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2129 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.393769:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2129 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896022.393787:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789896022.393789:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:0.0:1789896022.393791:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789896022.393805:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.393820:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.393827:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896022.393839:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003516288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.393862:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.393886:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896022.393909:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003516288 00000100:00100000:2.0:1789896022.393914:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003516288 00000100:00100000:2.0:1789896022.393938:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:2.0:1789896022.393944:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003516288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896022.393952:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896022.393960:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2130 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.393975:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2130 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.393985:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2130 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.393998:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8e00, rc 0) 00000100:00100000:2.0:1789896022.394028:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003516288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896022.394035:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00100000:0.0:1789896022.394061:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003516288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896022.394073:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2137 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.394083:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2137 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896022.394122:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003516416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896022.394147:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896022.394166:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a952f25e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896022.394186:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003516416 00000100:00100000:3.0:1789896022.394192:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003516416 00000100:00100000:3.0:1789896022.394252:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:3.0:1789896022.394260:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003516416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.394306:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003516416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 47us (158us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789896022.394314:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00100000:0.0:1789896022.394323:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003516416:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789896022.394356:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789896022.394361:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2137 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896022.394370:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2137 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896022.579759:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896022.579834:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015946624 00000100:00100000:2.0:1789896022.579846:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015946624 00000100:00100000:2.0:1789896022.579904:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1962 00000100:00100000:2.0:1789896022.579916:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015946624:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896022.579933:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896022.579968:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a213e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f598 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.579997:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a213e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f598 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.580010:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a213e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f598 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896022.580020:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8600, rc 0) 00000100:00100000:2.0:1789896022.580077:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015946624:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 163us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896022.580084:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1962 00000100:00100000:2.0:1789896022.580939:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896022.580982:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015946752 00000100:00100000:3.0:1789896022.580988:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015946752 00000100:00100000:3.0:1789896022.581019:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1963 00000100:00100000:3.0:1789896022.581030:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015946752:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896022.581153:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015946752:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 125us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.581161:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1963 00000100:00100000:1.0:1789896022.581782:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896022.581832:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015946880 00000100:00100000:2.0:1789896022.581837:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015946880 00000100:00100000:2.0:1789896022.581868:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1964 00000100:00100000:2.0:1789896022.581876:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015946880:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896022.581980:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015946880:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 105us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896022.581988:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1964 00000100:00100000:1.0:1789896022.582988:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896022.583029:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015947008 00000100:00100000:3.0:1789896022.583034:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015947008 00000100:00100000:3.0:1789896022.583101:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1965 00000100:00100000:3.0:1789896022.583110:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:212695:x1876838015947008:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789896022.583194:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:212695:x1876838015947008:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 85us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.583238:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1965 00000100:00100000:0.0:1789896022.583872:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896022.583930:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015947136 00000100:00100000:2.0:1789896022.583934:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015947136 00000100:00100000:2.0:1789896022.583958:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1966 00000100:00100000:2.0:1789896022.583965:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:212695:x1876838015947136:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896022.584033:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:212695:x1876838015947136:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 67us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896022.584051:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1966 00000100:00100000:1.0:1789896022.584825:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896022.584871:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015947264 00000100:00100000:3.0:1789896022.584877:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015947264 00000100:00100000:3.0:1789896022.584955:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1967 00000100:00100000:3.0:1789896022.584963:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015947264:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896022.584973:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896022.584987:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a2145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f59f expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.585006:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a2145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f59f expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.585018:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a2145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f59f expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896022.585027:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3c00, rc 0) 00000100:00100000:3.0:1789896022.585059:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015947264:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 97us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896022.585072:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1967 00000100:00100000:1.0:1789896022.585719:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896022.585764:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015947392 00000100:00100000:2.0:1789896022.585769:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015947392 00000100:00100000:2.0:1789896022.585799:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 1968 00000100:00100000:2.0:1789896022.585808:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015947392:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896022.585883:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015947392:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 77us (165us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789896022.585894:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 1968 00010000:00010000:3.0:1789896023.020372:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789896023.521341:0:213190:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd42dcc8d0 20000000:00000080:1.0:1789896023.521357:0:213190:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91aa654fa800 uarg=0000000000000000 00000040:00100000:1.0:1789896023.521975:0:213190:0:(llog.c:1072:llog_reverse_process()) index 155 : idx 137 20000000:01000000:1.0:1789896023.521986:0:213190:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 154 cmd:0xce022 lustre.qpool2 lustre-OST0001_UUID 20000000:01000000:1.0:1789896023.521999:0:213190:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.qpool2 fl=4 20000000:01000000:1.0:1789896023.522335:0:213191:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 138 marker 148 1->4: lustre-clilov new lustre.qpool2 20000000:01000000:1.0:1789896023.522377:0:213191:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 140 marker 148 2->4: lustre-clilov new lustre.qpool2 00000040:00080000:1.0:1789896023.522390:0:213191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 156 count 153 00000040:00080000:2.0:1789896023.522521:0:213190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].156, 224 off36624 20000000:01000000:2.0:1789896023.522534:0:213190:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:2.0:1789896023.522548:0:213190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].157, 104 off36728 00000040:00080000:2.0:1789896023.522570:0:213190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].158, 224 off36952 20000000:01000000:2.0:1789896023.522589:0:213190:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.qpool2 fl=4 20000000:01000000:1.0:1789896023.522861:0:213192:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 160 marker 149 1->4: lustre-MDT0000-mdtlov new lustre.qpool2 20000000:01000000:1.0:1789896023.522877:0:213192:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 162 marker 149 2->4: lustre-MDT0000-mdtlov new lustre.qpool2 00000040:00080000:1.0:1789896023.522889:0:213192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 178 count 175 00000040:00080000:2.0:1789896023.522963:0:213190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].178, 224 off40800 20000000:01000000:2.0:1789896023.522970:0:213190:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:2.0:1789896023.522979:0:213190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].179, 112 off40912 00000040:00080000:2.0:1789896023.522991:0:213190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].181, 224 off41184 20000000:01000000:2.0:1789896023.522998:0:213190:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.qpool2 fl=4 20000000:01000000:1.0:1789896023.523446:0:213193:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 160 marker 150 1->4: lustre-MDT0001-mdtlov new lustre.qpool2 20000000:01000000:1.0:1789896023.523462:0:213193:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 162 marker 150 2->4: lustre-MDT0001-mdtlov new lustre.qpool2 00000040:00080000:1.0:1789896023.523473:0:213193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 178 count 175 00000040:00080000:2.0:1789896023.523546:0:213190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].178, 224 off40800 20000000:01000000:2.0:1789896023.523552:0:213190:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:2.0:1789896023.523560:0:213190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].179, 112 off40912 00000040:00080000:2.0:1789896023.523572:0:213190:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].181, 224 off41184 10000000:01000000:2.0:1789896023.523579:0:213190:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789896023.523594:0:213190:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523608:0:213190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a20c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a20c0 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523622:0:213190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a20d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a20ce expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523626:0:213190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a20e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a20dc expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523629:0:213190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a20f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a20ea expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523633:0:213190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a20ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a20f8 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523637:0:213190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a210d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2106 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523640:0:213190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a211b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2114 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523644:0:213190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2122 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523648:0:213190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2130 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523654:0:213190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a213e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f598 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523658:0:213190:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a2145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f59f expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523668:0:213190:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523698:0:213190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a2145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f59f expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523708:0:213190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a2145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f59f expref: 9 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.523727:0:213190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003516544:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789896023.523801:0:213190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a213e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f598 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523812:0:213190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a213e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f598 expref: 9 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.523817:0:213190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003516672:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789896023.523840:0:213190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2130 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523848:0:213190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2130 expref: 23 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.523857:0:213190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003516800:0@lo:104: 00000100:00100000:2.0:1789896023.523903:0:213190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896023.523931:0:213190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2122 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.523948:0:213190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2122 expref: 23 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896023.523950:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003516800 00000100:00100000:1.0:1789896023.523959:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003516800 00000100:00100000:2.0:1789896023.523961:0:213190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003516928:0@lo:104: 00000100:00100000:2.0:1789896023.523993:0:213190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896023.524020:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003516928 00000100:00100000:1.0:1789896023.524024:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003516928 00010000:00010000:2.0:1789896023.524033:0:213190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a211b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2114 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.524043:0:213190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a211b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2114 expref: 23 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.524053:0:213190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517056:0@lo:104: 00000100:00100000:0.0:1789896023.524058:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1789896023.524068:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1789896023.524072:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213190:x1876838003516800:12345-0@lo:104: 00000100:00100000:1.0:1789896023.524083:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213190:x1876838003516928:12345-0@lo:104: 00000100:00100000:2.0:1789896023.524084:0:213190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896023.524085:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2137 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.524101:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2129 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.524104:0:213190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a210d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2106 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.524117:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003517056 00010000:00010000:2.0:1789896023.524121:0:213190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a210d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2106 expref: 23 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.524131:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003517056 00000100:00100000:2.0:1789896023.524131:0:213190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517184:0@lo:104: 00010000:00010000:0.0:1789896023.524166:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789896023.524174:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:213190:x1876838003516800:12345-0@lo:104: Request processed in 106us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896023.524176:0:213190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896023.524176:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789896023.524190:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1789896023.524191:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:213190:x1876838003516928:12345-0@lo:104: Request processed in 110us (194us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896023.524195:0:213190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a20ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a20f8 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896023.524242:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00010000:00010000:2.0:1789896023.524255:0:213190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a20ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a20f8 expref: 23 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.524269:0:213190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517312:0@lo:104: 00000100:00100000:0.0:1789896023.524271:0:188715:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789896023.524278:0:188714:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:3.0:1789896023.524291:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003517184 00000100:00100000:3.0:1789896023.524298:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003517184 00000100:00100000:1.0:1789896023.524299:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789896023.524313:0:213190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896023.524325:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213190:x1876838003517056:12345-0@lo:104: 00000100:00100000:0.0:1789896023.524326:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003517312 00000100:00100000:0.0:1789896023.524332:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003517312 00010000:00010000:1.0:1789896023.524339:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a211b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.524343:0:213190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a20f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a20ea expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896023.524360:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00010000:00010000:2.0:1789896023.524369:0:213190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a20f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a20ea expref: 23 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896023.524371:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950859f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:213190:x1876838003517312:12345-0@lo:104: 00000100:00100000:2.0:1789896023.524381:0:213190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517440:0@lo:104: 00010000:00010000:0.0:1789896023.524385:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20ff expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.524407:0:213190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896023.524412:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789896023.524420:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:213190:x1876838003517056:12345-0@lo:104: Request processed in 112us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896023.524428:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00010000:00010000:2.0:1789896023.524431:0:213190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a20e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a20dc expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.524438:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:2.0:1789896023.524440:0:213190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a20e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a20dc expref: 23 pid: 188726 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896023.524446:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950859f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213190:x1876838003517312:12345-0@lo:104: Request processed in 76us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896023.524447:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003517440 00000100:00100000:2.0:1789896023.524452:0:213190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f62300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517568:0@lo:104: 00000100:00100000:1.0:1789896023.524455:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003517440 00000100:00100000:0.0:1789896023.524468:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1789896023.524481:0:213190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896023.524486:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1789896023.524497:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003517568 00000100:00100000:1.0:1789896023.524502:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213190:x1876838003517440:12345-0@lo:104: 00000100:00100000:0.0:1789896023.524503:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003517568 00010000:00010000:2.0:1789896023.524504:0:213190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a20d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a20ce expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.524515:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00010000:00010000:2.0:1789896023.524518:0:213190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a20d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a20ce expref: 23 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.524519:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20f1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896023.524532:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1789896023.524537:0:213190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517696:0@lo:104: 00000100:00100000:0.0:1789896023.524548:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:213190:x1876838003517568:12345-0@lo:104: 00010000:00010000:0.0:1789896023.524558:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20e3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.524576:0:213190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896023.524581:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa770e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:213190:x1876838003517184:12345-0@lo:104: 00010000:00010000:1.0:1789896023.524589:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:3.0:1789896023.524597:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a210d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896023.524602:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:213190:x1876838003517440:12345-0@lo:104: Request processed in 104us (191us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896023.524612:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:2.0:1789896023.524614:0:213190:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a20c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a20c0 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896023.524630:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:213190:x1876838003517568:12345-0@lo:104: Request processed in 85us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896023.524631:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00010000:00010000:2.0:1789896023.524643:0:213190:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a20c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a20c0 expref: 23 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896023.524645:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1789896023.524654:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003517696 00000100:00100000:1.0:1789896023.524660:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003517696 00010000:00010000:0.0:1789896023.524675:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:2.0:1789896023.524682:0:213190:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517824:0@lo:104: 00010000:00010000:3.0:1789896023.524688:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:0.0:1789896023.524691:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2137 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.524702:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa770e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213190:x1876838003517184:12345-0@lo:104: Request processed in 173us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896023.524703:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1789896023.524723:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213190:x1876838003517696:12345-0@lo:104: 00000100:00100000:2.0:1789896023.524726:0:213190:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896023.524729:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5ac00 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:3.0:1789896023.524736:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00010000:00010000:1.0:1789896023.524738:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20d5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896023.524740:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2137 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.524744:0:213190:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947c6e780 going to sleep for 11 seconds 00010000:00010000:0.0:1789896023.524762:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2137 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.524771:0:213190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003516800:0@lo:104: 10000000:00010000:0.0:1789896023.524771:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2137 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896023.524783:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896023.524797:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789896023.524798:0:213190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003516928:0@lo:104: 00000100:00100000:1.0:1789896023.524809:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213190:x1876838003517696:12345-0@lo:104: Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896023.524816:0:213190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517056:0@lo:104: 00000100:00100000:2.0:1789896023.524826:0:213190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517184:0@lo:104: 00000100:00100000:2.0:1789896023.524835:0:213190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517312:0@lo:104: 00000100:00100000:2.0:1789896023.524841:0:213190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517440:0@lo:104: 00010000:00010000:0.0:1789896023.524849:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2137 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.524851:0:213190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f62300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517568:0@lo:104: 00000100:00100000:2.0:1789896023.524868:0:213190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517696:0@lo:104: 00000100:00100000:1.0:1789896023.524884:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00010000:00010000:0.0:1789896023.524884:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896023.524923:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003517824 00010000:00010000:2.0:1789896023.524924:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789896023.524928:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2137 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.524931:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2129 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896023.524936:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003517824 00010000:00010000:2.0:1789896023.524950:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2a00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:0.0:1789896023.524950:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2137 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896023.524956:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2129 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.524969:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2129 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.524973:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00000100:00100000:1.0:1789896023.524977:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00010000:00010000:0.0:1789896023.524982:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a211b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896023.524983:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2129 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896023.524988:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213190:x1876838003517824:12345-0@lo:104: 00010000:00010000:1.0:1789896023.525002:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20c7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.525004:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a000 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896023.525011:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a211b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896023.525027:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896023.525030:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a211b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896023.525042:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a211b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896023.525048:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896023.525054:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2129 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.525064:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896023.525075:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a211b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.525080:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:0.0:1789896023.525082:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896023.525091:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213190:x1876838003517824:12345-0@lo:104: Request processed in 102us (373us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896023.525092:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2129 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.525093:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a211b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896023.525106:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00010000:00010000:2.0:1789896023.525117:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d2a00/0x412fd4b3617a2122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2129 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.525118:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a2114 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a211b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.525133:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789896023.525134:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789896023.525139:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20ff expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.525141:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20f1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.525143:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789896023.525155:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20e3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.525163:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b400 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896023.525169:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a200 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896023.525170:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a20ff expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.525171:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2e00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896023.525173:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a20f1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896023.525178:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a20e3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.525191:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a20ff expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.525196:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a20f1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.525232:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a20e3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896023.525241:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a20f1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896023.525249:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a20ff expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896023.525256:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a20e3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896023.525261:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789896023.525265:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789896023.525274:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789896023.525283:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:1.0:1789896023.525293:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20f1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.525294:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20ff expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.525300:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20e3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.525313:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896023.525315:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896023.525318:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896023.525326:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20ff expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.525328:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20f1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.525331:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20e3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.525334:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:2.0:1789896023.525350:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a20f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20ff expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.525363:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a200/0x412fd4b3617a20ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20f1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.525363:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d2e00/0x412fd4b3617a20dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20e3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.525368:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789896023.525373:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a210d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.525376:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003518208:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896023.525399:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a400 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896023.525401:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:2.0:1789896023.525403:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a210d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.525405:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789896023.525407:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20d5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.525412:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a20c7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.525424:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a210d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.525428:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5be00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896023.525439:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a20d5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.525442:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789896023.525459:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a210d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896023.525470:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896023.525470:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a20d5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.525472:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3600 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896023.525480:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a20c7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896023.525491:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a20d5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.525491:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a20c7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.525498:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a210d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.525506:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 10000000:00010000:0.0:1789896023.525516:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a20c7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896023.525517:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896023.525518:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789896023.525525:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003518080:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896023.525530:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a210d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.525542:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20d5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896023.525542:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896023.525546:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a2106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a210d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.525562:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896023.525563:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20c7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.525571:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20d5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.525580:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896023.525581:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896023.525597:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20c7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.525600:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a20ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20d5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.525608:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896023.525613:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896023.525614:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003518592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896023.525614:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a20c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a20c7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.525618:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896023.525625:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896023.525635:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896023.525638:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1789896023.525643:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896023.525655:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896023.525656:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896023.525657:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003518720:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896023.525665:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896023.525665:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896023.525675:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896023.525693:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003517952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896023.525703:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896023.525718:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896023.525740:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003518336:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896023.525745:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015947520 00000100:00100000:0.0:1789896023.525750:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015947648 00000100:00100000:3.0:1789896023.525752:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015947520 00000100:00100000:0.0:1789896023.525757:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015947648 00010000:00010000:0.0:1789896023.525786:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a213e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f598 expref: 11 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896023.525791:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896023.525792:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a2145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f59f expref: 11 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.525792:0:213190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003516544:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789896023.525816:0:213190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003516672:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789896023.525818:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003518848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896023.525831:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003518208 00000100:00100000:3.0:1789896023.525837:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003518208 00000100:00100000:2.0:1789896023.525838:0:213190:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213190:1876838003517824:0@lo:104: 00000100:00100000:0.0:1789896023.525849:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003518080 00000100:00100000:0.0:1789896023.525857:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003518080 00010000:00010000:3.0:1789896023.525860:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a211b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2114 expref: 24 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896023.525864:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896023.525883:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2122 expref: 25 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.525893:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003518592 00000100:00100000:3.0:1789896023.525899:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003518592 00000100:00100000:0.0:1789896023.525913:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003518720 00000100:00100000:0.0:1789896023.525920:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003518720 00010000:00010000:3.0:1789896023.525921:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a20e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a20dc expref: 26 pid: 188726 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.525922:0:213190:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896023.525931:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003518336 00000100:00100000:1.0:1789896023.525941:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003518336 00010000:00010000:0.0:1789896023.525948:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a210d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2106 expref: 27 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.525966:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a20f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a20ea expref: 28 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.525981:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003518848 00000100:00100000:3.0:1789896023.525987:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003518848 00000100:00100000:0.0:1789896023.525990:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 460 00000100:00100000:1.0:1789896023.526003:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 461 00000100:00100000:0.0:1789896023.526003:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015947520:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789896023.526011:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a20d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a20ce expref: 29 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.526016:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00010000:00010000:0.0:1789896023.526018:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896023.526026:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015947648:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789896023.526033:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a2145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f59f expref: 11 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.526040:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+29:3618:x1876838003518208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896023.526055:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896023.526058:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896023.526066:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a213e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f598 expref: 11 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.526071:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a211b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2114 expref: 29 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.526072:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a2145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f59f expref: 11 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.526074:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:3.0:1789896023.526102:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+29:3618:x1876838003518080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896023.526113:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a211b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2114 expref: 29 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896023.526118:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896023.526130:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2122 expref: 29 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.526131:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a213e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f598 expref: 11 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.526174:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a2145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f59f expref: 11 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.526178:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a211b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2114 expref: 29 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896023.526186:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 19 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2122 expref: 29 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.526263:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896023.526264:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896023.526264:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a213e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f598 expref: 10 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896023.526277:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2122 expref: 28 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.526279:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896023.526299:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896023.526301:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a50850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6f6720b-db77-464e-82b6-5f314c431303+9:2404:x1876838015947520:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 302us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896023.526313:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 460 00000100:00100000:1.0:1789896023.526315:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f6720b-db77-464e-82b6-5f314c431303+9:2404:x1876838015947648:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 295us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896023.526322:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+27:3618:x1876838003518208:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896023.526329:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 461 00000100:00100000:2.0:1789896023.526344:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00000100:00100000:3.0:1789896023.526355:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+27:3618:x1876838003518080:12345-0@lo:103:ldlm_bl.0 Request processed in 260us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896023.526367:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:1.0:1789896023.526376:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1789896023.526385:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:1.0:1789896023.526394:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003518592:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896023.526403:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3617:x1876838003518720:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896023.526403:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 466 00010000:00010000:1.0:1789896023.526406:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789896023.526415:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00010000:00010000:1.0:1789896023.526417:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a20e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a20dc expref: 25 pid: 188726 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896023.526421:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3615:x1876838003518336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896023.526430:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896023.526436:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a20e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a20dc expref: 25 pid: 188726 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.526439:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3615:x1876838003518848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896023.526448:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896023.526449:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a210d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2106 expref: 25 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.526463:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a20f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a20ea expref: 25 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896023.526464:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896023.526475:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c7600/0x412fd4b3617a20e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a20dc expref: 25 pid: 188726 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896023.526479:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a20d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a20ce expref: 25 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.526482:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a210d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2106 expref: 25 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.526528:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a20f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a20ea expref: 24 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.526537:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896023.526543:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a20d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a20ce expref: 24 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.526561:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3000/0x412fd4b3617a210d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2106 expref: 24 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.526566:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a20f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a20ea expref: 24 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896023.526575:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a20d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a20ce expref: 24 pid: 188723 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.526581:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896023.526585:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b40380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3618:x1876838003518592:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (922us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896023.526588:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896023.526615:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3617:x1876838003518720:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (900us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896023.526623:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896023.526623:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:2.0:1789896023.526633:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:0.0:1789896023.526643:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3615:x1876838003518336:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896023.526653:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 466 00000100:00100000:3.0:1789896023.526674:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3615:x1876838003518848:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896023.526683:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1789896023.526687:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003518720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896023.526711:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003518336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896023.526733:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003518848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896023.526768:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003518080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896023.526774:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896023.526799:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003518592:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896023.526809:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003517952 00000100:00100000:1.0:1789896023.526817:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003517952 00000100:00100000:2.0:1789896023.526827:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003518464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896023.526837:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2130 expref: 18 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896023.526857:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896023.526869:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003518464 00000100:00100000:3.0:1789896023.526873:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003518208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896023.526875:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003518464 00000100:00100000:2.0:1789896023.526881:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003518976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896023.526889:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 468 00010000:00010000:1.0:1789896023.526898:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a20ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a20f8 expref: 19 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896023.526907:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3616:x1876838003517952:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896023.526920:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896023.526921:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896023.526929:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2130 expref: 19 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896023.526933:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003518976 00000100:00100000:1.0:1789896023.526939:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003518976 00000100:00100000:3.0:1789896023.526948:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00010000:00010000:0.0:1789896023.526950:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2130 expref: 20 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.526959:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a20c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a20c0 expref: 20 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.526967:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3616:x1876838003518464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896023.526970:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2130 expref: 20 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896023.526995:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896023.527010:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a20ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a20f8 expref: 20 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896023.527023:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896023.527037:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a20ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a20f8 expref: 19 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896023.527047:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 470 00010000:00010000:3.0:1789896023.527057:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9a00/0x412fd4b3617a20ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a20f8 expref: 19 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896023.527064:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3616:x1876838003518976:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896023.527065:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a52450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3616:x1876838003517952:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896023.527082:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003517952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896023.527088:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789896023.527098:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 468 00010000:00010000:1.0:1789896023.527102:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a20c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a20c0 expref: 19 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.527122:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a20c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a20c0 expref: 17 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896023.527134:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896023.527142:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a20c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a20c0 expref: 17 pid: 188725 timeout: 3995 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.527157:0:188717:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.527165:0:188717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.527182:0:188717:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.527189:0:188717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896023.527191:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3616:x1876838003518464:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896023.527245:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003518464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896023.527254:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00010000:00010000:1.0:1789896023.527286:0:188717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.527294:0:188717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.527311:0:188717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9800 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:1.0:1789896023.527316:0:188717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.527323:0:188717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.527338:0:188717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.527348:0:213190:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896023.527350:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896023.527357:0:213190:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896023.527362:0:213190:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a214c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213190 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896023.527398:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3616:x1876838003518976:12345-0@lo:103:ldlm_bl.0 Request processed in 341us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896023.527408:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 470 00000100:00100000:3.0:1789896023.527439:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003518976:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896023.923701:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896023.923741:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896023.923766:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015947904 00000100:00100000:3.0:1789896023.923777:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015947904 00000100:00100000:1.0:1789896023.923819:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015947776 00000100:00080000:0.0:1789896023.923833:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789896023.923834:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015947776 00000100:00100000:3.0:1789896023.923866:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 482 00000100:00100000:3.0:1789896023.923882:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2402:x1876838015947904:12345-192.168.202.44@tcp:400:kworker.0 00000100:00080000:0.0:1789896023.923895:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789896023.923927:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 483 00000100:00100000:1.0:1789896023.923942:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2401:x1876838015947776:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789896023.923987:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2402:x1876838015947904:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 106us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896023.923998:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 482 00000100:00100000:1.0:1789896023.924020:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2401:x1876838015947776:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 69us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896023.924031:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 483 00010000:00010000:2.0:1789896024.046311:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896024.492393:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003519232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789896024.492393:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003519360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789896024.492419:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003519104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789896024.492483:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896024.492525:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003519360 00000100:00100000:3.0:1789896024.492540:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003519360 00000100:00100000:2.0:1789896024.492547:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896024.492565:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003519872:0@lo:400:kworker.0 00000100:00100000:2.0:1789896024.492584:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003519616:0@lo:400:kworker.0 00000100:00100000:3.0:1789896024.492623:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003519232 00000100:00100000:0.0:1789896024.492623:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896024.492631:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003519232 00000100:00100000:2.0:1789896024.492632:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.492667:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003520128:0@lo:400:kworker.0 00000100:00100000:1.0:1789896024.492681:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003519488:0@lo:400:kworker.0 00000100:00100000:3.0:1789896024.492682:0:190238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789896024.492689:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003520384:0@lo:400:kworker.0 00000100:00100000:2.0:1789896024.492694:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896024.492702:0:190238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003519360:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789896024.492722:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876838003520640:0@lo:400:kworker.0 00002000:00000024:3.0:1789896024.492742:0:190238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789896024.492751:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.492752:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.492767:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.492809:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876838003520000:0@lo:400:kworker.0 00000100:00100000:0.0:1789896024.492811:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876838003520896:0@lo:400:kworker.0 00000100:00100000:2.0:1789896024.492813:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789896024.492824:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003519744:0@lo:400:kworker.0 00000100:00100000:3.0:1789896024.492844:0:190238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003519360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.492852:0:190238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789896024.492870:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.492875:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896024.492889:0:190238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1789896024.492896:0:190238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003519232:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789896024.492916:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003520640 00002000:00000024:3.0:1789896024.492921:0:190238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789896024.492924:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003520640 00000100:00100000:2.0:1789896024.492927:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003520256:0@lo:400:kworker.0 00000100:00100000:1.0:1789896024.492928:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876838003520512:0@lo:400:kworker.0 00000100:00100000:2.0:1789896024.492983:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896024.492988:0:190238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003519232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.492989:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003520000 00000100:00100000:0.0:1789896024.492998:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003520000 00000100:00100000:3.0:1789896024.493019:0:190238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789896024.493020:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876838003520768:0@lo:400:kworker.0 00000100:00100000:1.0:1789896024.493020:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896024.493041:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003520512 00000100:00100000:0.0:1789896024.493046:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003520512 00000100:00100000:1.0:1789896024.493066:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876838003521024:0@lo:400:kworker.0 00000100:00100000:3.0:1789896024.493072:0:190235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003519872 00000100:00100000:2.0:1789896024.493077:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896024.493080:0:190235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003519872 00000100:00100000:0.0:1789896024.493085:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:0.0:1789896024.493104:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+8:3617:x1876838003520640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896024.493118:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896024.493138:0:190235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003520384 00000100:00100000:2.0:1789896024.493143:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003519232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789896024.493145:0:190235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003520384 00000100:00100000:0.0:1789896024.493165:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+8:3617:x1876838003520640:12345-0@lo:400:kworker.0 Request processed in 68us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896024.493171:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003519488 00000100:00100000:0.0:1789896024.493177:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1789896024.493180:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003519488 00000100:00100000:3.0:1789896024.493187:0:190235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003519744 00000100:00100000:2.0:1789896024.493242:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876838003520640:0@lo:400:kworker.0 00000100:00100000:3.0:1789896024.493244:0:190235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003519744 00000100:00100000:1.0:1789896024.493278:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:0.0:1789896024.493281:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003520768 00000100:00100000:3.0:1789896024.493283:0:190235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003520256 00000100:00100000:0.0:1789896024.493287:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003520768 00000100:00100000:3.0:1789896024.493290:0:190235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003520256 00000100:00100000:1.0:1789896024.493292:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3616:x1876838003519488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896024.493300:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003519616 00000100:00100000:2.0:1789896024.493305:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003519616 00000100:00100000:0.0:1789896024.493325:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003521024 00000100:00100000:0.0:1789896024.493331:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003521024 00000100:00100000:3.0:1789896024.493337:0:190235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789896024.493349:0:190235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003519872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896024.493356:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003520128 00000100:00100000:2.0:1789896024.493361:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003520128 00000100:00100000:1.0:1789896024.493363:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3616:x1876838003519488:12345-0@lo:400:kworker.0 Request processed in 74us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.493365:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:0.0:1789896024.493377:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3616:x1876838003520000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896024.493378:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:2.0:1789896024.493400:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1789896024.493406:0:190235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003519872:12345-0@lo:400:kworker.0 Request processed in 59us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896024.493416:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003519616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896024.493428:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+11:3616:x1876838003520000:12345-0@lo:400:kworker.0 Request processed in 54us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.493435:0:190235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789896024.493441:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1789896024.493448:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789896024.493461:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003520384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896024.493496:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:3.0:1789896024.493499:0:190235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789896024.493501:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003519616:12345-0@lo:400:kworker.0 Request processed in 86us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.493515:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+11:3616:x1876838003520512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896024.493516:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789896024.493516:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003520384:12345-0@lo:400:kworker.0 Request processed in 53us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.493526:0:190235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003519744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896024.493544:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789896024.493551:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789896024.493556:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003520128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896024.493559:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+11:3616:x1876838003520512:12345-0@lo:400:kworker.0 Request processed in 49us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.493568:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1789896024.493591:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789896024.493603:0:190235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003519744:12345-0@lo:400:kworker.0 Request processed in 84us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.493603:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1789896024.493612:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003520256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896024.493616:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003520128:12345-0@lo:400:kworker.0 Request processed in 56us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.493631:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876838003520768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896024.493642:0:190235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789896024.493643:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789896024.493685:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003520256:12345-0@lo:400:kworker.0 Request processed in 84us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896024.493699:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789896024.493699:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876838003520768:12345-0@lo:400:kworker.0 Request processed in 74us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896024.493705:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:2.0:1789896024.493717:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876838003521024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896024.493717:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1789896024.493761:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.493774:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876838003521024:12345-0@lo:400:kworker.0 Request processed in 60us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896024.493780:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:3.0:1789896024.493788:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003519744:0@lo:400:kworker.0 00000100:00080000:0.0:1789896024.493798:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789896024.493799:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003520896 00000100:00100000:2.0:1789896024.493805:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003520896 00000100:00080000:0.0:1789896024.493809:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789896024.493816:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789896024.493823:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003519872:0@lo:400:kworker.0 00000100:00080000:0.0:1789896024.493824:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789896024.493829:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003520256:0@lo:400:kworker.0 00000100:00100000:2.0:1789896024.493841:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1789896024.493855:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+8:3615:x1876838003520896:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789896024.493865:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a948bc6300 x1876838003520768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789896024.493874:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003519360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789896024.493874:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.493888:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+8:3615:x1876838003520896:12345-0@lo:400:kworker.0 Request processed in 34us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.493910:0:203484:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003519104 00000100:00100000:3.0:1789896024.493914:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876838003520768:0@lo:400:kworker.0 00000100:00100000:0.0:1789896024.493917:0:203484:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003519104 00000100:00100000:1.0:1789896024.493937:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003520384:0@lo:400:kworker.0 00000100:00100000:2.0:1789896024.493938:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:3.0:1789896024.493949:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003519616:0@lo:400:kworker.0 00000100:00100000:0.0:1789896024.493972:0:203484:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789896024.493986:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003520128:0@lo:400:kworker.0 00000100:00100000:0.0:1789896024.493988:0:203484:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003519104:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789896024.493997:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3615:1876838003520896:0@lo:400:kworker.0 00002000:00000024:0.0:1789896024.494009:0:203484:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896024.494042:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003519488:0@lo:400:kworker.0 00000100:00100000:2.0:1789896024.494073:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876838003520000:0@lo:400:kworker.0 00000100:00100000:0.0:1789896024.494075:0:203484:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003519104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.494086:0:203484:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789896024.494097:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876838003520512:0@lo:400:kworker.0 00010000:00080000:2.0:1789896024.494116:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a94681f100 x1876838003521024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789896024.494116:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003519104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789896024.494133:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876838003521024:0@lo:400:kworker.0 10000000:01000000:1.0:1789896024.620279:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896024.620285:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 156 10000000:01000000:1.0:1789896024.620289:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896024.620330:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.620339:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.620347:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.620367:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003521152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.620423:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.620459:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896024.620476:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003521152 00000100:00100000:2.0:1789896024.620484:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003521152 00000100:00100000:2.0:1789896024.620526:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:2.0:1789896024.620534:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003521152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896024.620545:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896024.620555:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a215a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2153 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896024.620573:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a215a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2153 expref: 16 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896024.620585:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a215a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2153 expref: 16 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896024.620592:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8200, rc 0) 00000100:00100000:2.0:1789896024.620624:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003521152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896024.620630:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00100000:1.0:1789896024.620654:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003521152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896024.620668:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a215a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.620676:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a215a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.620731:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003521280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.620750:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.620765:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.620801:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003521280 00000100:00100000:3.0:1789896024.620807:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003521280 00000100:00100000:3.0:1789896024.620844:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1971 00000100:00100000:3.0:1789896024.620852:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003521280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896024.620960:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003521280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.620967:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1971 00000100:00100000:1.0:1789896024.620981:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003521280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.621005:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003521408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.621047:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.621064:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896024.621086:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003521408 00000100:00100000:2.0:1789896024.621090:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003521408 00000100:00100000:2.0:1789896024.621111:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1789896024.621117:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003521408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.621225:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003521408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896024.621244:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003521408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896024.621253:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00100000:2.0:1789896024.621449:0:213195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213195:1876838003521536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.621475:0:213195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.621492:0:213195:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947c6ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.621510:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003521536 00000100:00100000:3.0:1789896024.621514:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003521536 00000100:00100000:3.0:1789896024.621534:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:3.0:1789896024.621540:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:213195:x1876838003521536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896024.621621:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:213195:x1876838003521536:12345-0@lo:502:llog_process_th.0 Request processed in 82us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.621626:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:2.0:1789896024.621656:0:213195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213195:1876838003521536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.621699:0:213195:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213195:1876838003521664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.621732:0:213195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.621754:0:213195:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947c6ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.621782:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003521664 00000100:00100000:3.0:1789896024.621788:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003521664 00000100:00100000:3.0:1789896024.621815:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:3.0:1789896024.621823:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:213195:x1876838003521664:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896024.621892:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:213195:x1876838003521664:12345-0@lo:502:llog_process_th.0 Request processed in 71us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.621898:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:2.0:1789896024.621923:0:213195:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213195:1876838003521664:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896024.621946:0:213195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 159 count 156 00000020:01000000:1.0:1789896024.622013:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 156-158 (rc=0) 10000000:01000000:1.0:1789896024.622041:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896024.622047:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a215a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.622057:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a215a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896024.622065:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789896024.622067:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:1.0:1789896024.622069:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789896024.622083:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.622090:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.622097:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.622109:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003521792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.622134:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.622148:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.622168:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003521792 00000100:00100000:3.0:1789896024.622172:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003521792 00000100:00100000:3.0:1789896024.622220:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1975 00000100:00100000:3.0:1789896024.622228:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003521792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896024.622234:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896024.622244:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2161 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896024.622273:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2161 expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896024.622286:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2161 expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896024.622294:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2600, rc 0) 00000100:00100000:3.0:1789896024.622327:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003521792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.622335:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1975 00000100:00100000:1.0:1789896024.622338:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003521792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896024.622354:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2168 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.622363:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2168 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.622398:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003521920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.622420:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.622436:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.622459:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003521920 00000100:00100000:3.0:1789896024.622464:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003521920 00000100:00100000:3.0:1789896024.622487:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:3.0:1789896024.622492:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003521920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896024.622543:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003521920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 51us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.622556:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:1.0:1789896024.622565:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003521920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.622592:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003522048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.622625:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.622642:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.622660:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003522048 00000100:00100000:3.0:1789896024.622665:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003522048 00000100:00100000:3.0:1789896024.622690:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:3.0:1789896024.622698:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003522048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896024.622769:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003522048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.622777:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00100000:1.0:1789896024.622784:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003522048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789896024.623530:0:213196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 35 00000020:01000000:1.0:1789896024.623600:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-34 (rc=0) 10000000:01000000:1.0:1789896024.623615:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789896024.623618:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2168 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.623624:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2168 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896024.623628:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896024.623629:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 156 10000000:01000000:1.0:1789896024.623631:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896024.623640:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.623649:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.623654:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.623662:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003522176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.623679:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.623695:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.623721:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003522176 00000100:00100000:3.0:1789896024.623726:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003522176 00000100:00100000:3.0:1789896024.623757:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:3.0:1789896024.623767:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003522176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896024.623774:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896024.623782:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a216f expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896024.623797:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a216f expref: 18 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896024.623805:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a216f expref: 18 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896024.623812:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3e00, rc 0) 00000100:00100000:3.0:1789896024.623851:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003522176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896024.623854:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003522176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896024.623865:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00010000:00010000:1.0:1789896024.623867:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2176 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.623875:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2176 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.623905:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003522304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.623921:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.623931:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.623942:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003522304 00000100:00100000:3.0:1789896024.623948:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003522304 00000100:00100000:3.0:1789896024.623976:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:3.0:1789896024.623983:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003522304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896024.624039:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003522304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.624045:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:1.0:1789896024.624047:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003522304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.624068:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003522432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.624094:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896024.624112:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003522432 00000100:00100000:1.0:1789896024.624112:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.624116:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003522432 00000100:00100000:3.0:1789896024.624132:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:3.0:1789896024.624136:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003522432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896024.624183:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003522432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 45us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.624189:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:1.0:1789896024.624218:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003522432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896024.624388:0:213197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213197:1876838003522560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896024.624420:0:213197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896024.624446:0:213197:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a946b8bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.624461:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003522560 00000100:00100000:0.0:1789896024.624465:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003522560 00000100:00100000:0.0:1789896024.624487:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:0.0:1789896024.624493:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:213197:x1876838003522560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896024.624561:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:213197:x1876838003522560:12345-0@lo:502:llog_process_th.0 Request processed in 69us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.624566:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:3.0:1789896024.624591:0:213197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213197:1876838003522560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896024.624628:0:213197:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213197:1876838003522688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896024.624661:0:213197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896024.624682:0:213197:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a946b8bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896024.624698:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003522688 00000100:00100000:2.0:1789896024.624702:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003522688 00000100:00100000:2.0:1789896024.624721:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1982 00000100:00100000:2.0:1789896024.624725:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:213197:x1876838003522688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.624775:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:213197:x1876838003522688:12345-0@lo:502:llog_process_th.0 Request processed in 48us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896024.624780:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1982 00000100:00100000:3.0:1789896024.624795:0:213197:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213197:1876838003522688:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789896024.624818:0:213197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 159 count 156 00000020:01000000:1.0:1789896024.624875:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 156-158 (rc=0) 10000000:01000000:1.0:1789896024.624895:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896024.624902:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2176 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.624910:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2176 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896024.624918:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789896024.624920:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:1.0:1789896024.624922:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789896024.624935:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.624942:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.624948:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.624961:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003522816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.624986:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.625003:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.625020:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003522816 00000100:00100000:0.0:1789896024.625024:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003522816 00000100:00100000:0.0:1789896024.625043:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:0.0:1789896024.625048:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003522816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896024.625053:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896024.625062:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a217d expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896024.625077:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a217d expref: 19 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896024.625085:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a217d expref: 19 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896024.625092:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a000, rc 0) 00000100:00100000:0.0:1789896024.625126:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003522816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.625140:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:1.0:1789896024.625143:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003522816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896024.625157:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2184 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.625166:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2184 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.625237:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003522944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.625269:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.625295:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003522944 00000100:00100000:2.0:1789896024.625299:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003522944 00000100:00100000:1.0:1789896024.625299:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896024.625326:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:2.0:1789896024.625333:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003522944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896024.625393:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003522944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896024.625399:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00100000:1.0:1789896024.625412:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003522944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.625436:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003523072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.625465:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.625480:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.625499:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003523072 00000100:00100000:0.0:1789896024.625502:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003523072 00000100:00100000:0.0:1789896024.625521:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:0.0:1789896024.625526:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003523072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896024.625581:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003523072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.625587:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:1.0:1789896024.625601:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003523072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789896024.626130:0:213198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 38 00000020:01000000:1.0:1789896024.626227:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-37 (rc=0) 10000000:01000000:1.0:1789896024.626244:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789896024.626250:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2184 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.626259:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2184 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896024.626265:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896024.626267:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 156 10000000:01000000:1.0:1789896024.626268:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896024.626279:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.626284:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.626288:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.626296:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003523200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.626318:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.626340:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896024.626353:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003523200 00000100:00100000:2.0:1789896024.626359:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003523200 00000100:00100000:2.0:1789896024.626385:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1986 00000100:00100000:2.0:1789896024.626393:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003523200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896024.626401:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896024.626410:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a218b expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896024.626425:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a218b expref: 20 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896024.626449:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a218b expref: 20 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896024.626454:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8a00, rc 0) 00000100:00100000:2.0:1789896024.626479:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003523200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896024.626484:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1986 00000100:00100000:1.0:1789896024.626497:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003523200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896024.626506:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2192 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.626511:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2192 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.626536:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003523328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.626554:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.626567:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.626592:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003523328 00000100:00100000:0.0:1789896024.626596:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003523328 00000100:00100000:0.0:1789896024.626615:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:0.0:1789896024.626619:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003523328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896024.626671:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003523328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 52us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.626677:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00100000:1.0:1789896024.626693:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003523328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.626720:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003523456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.626751:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.626770:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896024.626792:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003523456 00000100:00100000:2.0:1789896024.626796:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003523456 00000100:00100000:2.0:1789896024.626824:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:2.0:1789896024.626832:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003523456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896024.626910:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003523456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896024.626917:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:1.0:1789896024.626927:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003523456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896024.627128:0:213199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213199:1876838003523584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.627159:0:213199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.627175:0:213199:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.627217:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003523584 00000100:00100000:0.0:1789896024.627222:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003523584 00000100:00100000:0.0:1789896024.627245:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:0.0:1789896024.627249:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:213199:x1876838003523584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896024.627304:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:213199:x1876838003523584:12345-0@lo:502:llog_process_th.0 Request processed in 55us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.627309:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:2.0:1789896024.627325:0:213199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213199:1876838003523584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.627353:0:213199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213199:1876838003523712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.627375:0:213199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.627393:0:213199:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8600 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.627414:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003523712 00000100:00100000:3.0:1789896024.627420:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003523712 00000100:00100000:3.0:1789896024.627458:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1990 00000100:00100000:3.0:1789896024.627467:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:213199:x1876838003523712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896024.627542:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:213199:x1876838003523712:12345-0@lo:502:llog_process_th.0 Request processed in 76us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.627551:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1990 00000100:00100000:2.0:1789896024.627554:0:213199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213199:1876838003523712:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896024.627574:0:213199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 159 count 156 00000020:01000000:1.0:1789896024.627610:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 156-158 (rc=0) 10000000:01000000:1.0:1789896024.627626:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896024.627631:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2192 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.627636:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2192 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896024.627641:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789896024.627647:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 178 10000000:01000000:1.0:1789896024.627648:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789896024.627658:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.627663:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.627667:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.627675:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003523840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.627693:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.627705:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.627722:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003523840 00000100:00100000:0.0:1789896024.627726:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003523840 00000100:00100000:0.0:1789896024.627744:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:0.0:1789896024.627749:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003523840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896024.627758:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896024.627764:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a21a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2199 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896024.627773:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a21a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2199 expref: 21 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896024.627778:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a21a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2199 expref: 21 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896024.627782:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5ac00, rc 0) 00000100:00100000:1.0:1789896024.627816:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003523840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896024.627821:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003523840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (123us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896024.627826:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a21a0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896024.627830:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00010000:00010000:1.0:1789896024.627837:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a21a0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.627865:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003523968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.627882:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.627898:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.627922:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003523968 00000100:00100000:3.0:1789896024.627927:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003523968 00000100:00100000:3.0:1789896024.627958:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:3.0:1789896024.627965:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003523968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896024.628033:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003523968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.628042:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:1.0:1789896024.628051:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003523968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.628077:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003524096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.628110:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.628134:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.628149:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003524096 00000100:00100000:0.0:1789896024.628153:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003524096 00000100:00100000:0.0:1789896024.628170:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:0.0:1789896024.628178:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003524096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896024.628278:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003524096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.628283:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00100000:1.0:1789896024.628307:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003524096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896024.628470:0:213200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213200:1876838003524224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.628494:0:213200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.628510:0:213200:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8780 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.628523:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003524224 00000100:00100000:3.0:1789896024.628527:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003524224 00000100:00100000:3.0:1789896024.628548:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1994 00000100:00100000:3.0:1789896024.628554:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:213200:x1876838003524224:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896024.628618:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:213200:x1876838003524224:12345-0@lo:502:llog_process_th.0 Request processed in 65us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.628625:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1994 00000100:00100000:2.0:1789896024.628630:0:213200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213200:1876838003524224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789896024.628648:0:213200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789896024.628655:0:213200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896024.628657:0:213200:0:(obd_config.c:1561:class_process_config()) marker 168 (0x1) lustre-MDT0001-m del lustre.qpool2 00000020:00000080:2.0:1789896024.628661:0:213200:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1789896024.628725:0:213200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213200:1876838003524352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.628748:0:213200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.628760:0:213200:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.628786:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003524352 00000100:00100000:0.0:1789896024.628791:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003524352 00000100:00100000:0.0:1789896024.628817:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:0.0:1789896024.628822:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:213200:x1876838003524352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896024.628882:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:213200:x1876838003524352:12345-0@lo:502:llog_process_th.0 Request processed in 58us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896024.628892:0:213200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213200:1876838003524352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896024.628900:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00100000:2.0:1789896024.628926:0:213200:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213200:1876838003524480:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.628952:0:213200:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.628967:0:213200:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8780 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.628981:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003524480 00000100:00100000:3.0:1789896024.628985:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003524480 00000100:00100000:3.0:1789896024.629004:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:3.0:1789896024.629008:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:213200:x1876838003524480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896024.629068:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:213200:x1876838003524480:12345-0@lo:502:llog_process_th.0 Request processed in 58us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.629074:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00100000:2.0:1789896024.629083:0:213200:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213200:1876838003524480:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789896024.629103:0:213200:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789896024.629108:0:213200:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896024.629109:0:213200:0:(obd_config.c:1561:class_process_config()) marker 168 (0x2) lustre-MDT0001-m del lustre.qpool2 00000040:00080000:2.0:1789896024.629112:0:213200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 182 count 178 00000020:01000000:1.0:1789896024.629150:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 178-181 (rc=0) 10000000:01000000:1.0:1789896024.629170:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789896024.629176:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a21a0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.629185:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a21a0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896024.629226:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789896024.629228:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 156 10000000:01000000:1.0:1789896024.629231:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789896024.629245:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.629252:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.629260:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.629271:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003524608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.629295:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.629319:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.629342:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003524608 00000100:00100000:0.0:1789896024.629346:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003524608 00000100:00100000:0.0:1789896024.629367:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:0.0:1789896024.629372:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003524608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896024.629378:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896024.629384:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5aa00/0x412fd4b3617a21ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a21a7 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896024.629393:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5aa00/0x412fd4b3617a21ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a21a7 expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896024.629399:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5aa00/0x412fd4b3617a21ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a21a7 expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896024.629403:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5aa00, rc 0) 00000100:00100000:0.0:1789896024.629435:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003524608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 56us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.629441:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000100:00100000:1.0:1789896024.629442:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003524608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896024.629456:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a21ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.629475:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a21ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.629508:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003524736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.629529:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.629544:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.629559:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003524736 00000100:00100000:3.0:1789896024.629562:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003524736 00000100:00100000:3.0:1789896024.629582:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1998 00000100:00100000:3.0:1789896024.629587:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003524736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896024.629635:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003524736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 47us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.629641:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1998 00000100:00100000:1.0:1789896024.629655:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003524736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.629678:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003524864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.629708:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.629723:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.629741:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003524864 00000100:00100000:0.0:1789896024.629745:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003524864 00000100:00100000:0.0:1789896024.629763:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:0.0:1789896024.629769:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003524864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896024.629818:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003524864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 50us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.629824:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00100000:1.0:1789896024.629833:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003524864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896024.630005:0:213201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213201:1876838003524992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896024.630031:0:213201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896024.630047:0:213201:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5930ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896024.630067:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003524992 00000100:00100000:2.0:1789896024.630073:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003524992 00000100:00100000:2.0:1789896024.630097:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:2.0:1789896024.630104:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:213201:x1876838003524992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.630182:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:213201:x1876838003524992:12345-0@lo:502:llog_process_th.0 Request processed in 77us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896024.630190:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00000100:00100000:3.0:1789896024.630225:0:213201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213201:1876838003524992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896024.630268:0:213201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213201:1876838003525120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896024.630302:0:213201:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896024.630323:0:213201:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5930ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.630342:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003525120 00000100:00100000:0.0:1789896024.630354:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003525120 00000100:00100000:0.0:1789896024.630382:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001 00000100:00100000:0.0:1789896024.630391:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:213201:x1876838003525120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896024.630469:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:213201:x1876838003525120:12345-0@lo:502:llog_process_th.0 Request processed in 79us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.630477:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001 00000100:00100000:3.0:1789896024.630490:0:213201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b43480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213201:1876838003525120:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789896024.630508:0:213201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 159 count 156 00000020:01000000:1.0:1789896024.630559:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 156-158 (rc=0) 10000000:01000000:1.0:1789896024.630576:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896024.630581:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a21ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.630589:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a21ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896024.630596:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789896024.630598:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 178 10000000:01000000:1.0:1789896024.630600:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789896024.630612:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.630620:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.630633:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.630645:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003525248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.630666:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.630680:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896024.630691:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003525248 00000100:00100000:2.0:1789896024.630695:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003525248 00000100:00100000:2.0:1789896024.630714:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2002 00000100:00100000:2.0:1789896024.630718:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003525248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896024.630723:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896024.630729:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a21bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a21b5 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896024.630739:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a21bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a21b5 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896024.630744:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a21bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a21b5 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896024.630754:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9000, rc 0) 00000100:00100000:2.0:1789896024.630778:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003525248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 60us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896024.630783:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2002 00000100:00100000:1.0:1789896024.630792:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003525248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896024.630803:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a21bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.630812:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a21bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.630843:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003525376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.630864:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.630878:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.630897:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003525376 00000100:00100000:0.0:1789896024.630902:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003525376 00000100:00100000:0.0:1789896024.630929:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:0.0:1789896024.630938:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003525376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896024.630997:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003525376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.631002:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:1.0:1789896024.631014:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003525376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.631037:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003525504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.631065:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.631080:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896024.631094:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003525504 00000100:00100000:2.0:1789896024.631098:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003525504 00000100:00100000:2.0:1789896024.631117:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:2.0:1789896024.631122:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003525504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896024.631181:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003525504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896024.631189:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00100000:1.0:1789896024.631219:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003525504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896024.631403:0:213202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213202:1876838003525632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.631428:0:213202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.631448:0:213202:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.631458:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003525632 00000100:00100000:0.0:1789896024.631462:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003525632 00000100:00100000:0.0:1789896024.631480:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:0.0:1789896024.631485:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:213202:x1876838003525632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896024.631543:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:213202:x1876838003525632:12345-0@lo:502:llog_process_th.0 Request processed in 58us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.631547:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00100000:2.0:1789896024.631571:0:213202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213202:1876838003525632:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789896024.631594:0:213202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789896024.631600:0:213202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896024.631601:0:213202:0:(obd_config.c:1561:class_process_config()) marker 167 (0x1) lustre-MDT0000-m del lustre.qpool2 00000020:00000080:2.0:1789896024.631605:0:213202:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1789896024.632187:0:213202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213202:1876838003525760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.632257:0:213202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896024.632287:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003525760 00000100:00100000:2.0:1789896024.632289:0:213202:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947c6ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.632291:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003525760 00000100:00100000:3.0:1789896024.632320:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2006 00000100:00100000:3.0:1789896024.632326:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:213202:x1876838003525760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896024.632394:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:213202:x1876838003525760:12345-0@lo:502:llog_process_th.0 Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.632402:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2006 00000100:00100000:2.0:1789896024.632408:0:213202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213202:1876838003525760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.632447:0:213202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213202:1876838003525888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896024.632483:0:213202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896024.632498:0:213202:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45121c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.632526:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003525888 00000100:00100000:0.0:1789896024.632532:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003525888 00000100:00100000:0.0:1789896024.632558:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:0.0:1789896024.632566:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:213202:x1876838003525888:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896024.632636:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:213202:x1876838003525888:12345-0@lo:502:llog_process_th.0 Request processed in 71us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896024.632651:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:2.0:1789896024.632663:0:213202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:213202:1876838003525888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789896024.632685:0:213202:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789896024.632690:0:213202:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896024.632692:0:213202:0:(obd_config.c:1561:class_process_config()) marker 167 (0x2) lustre-MDT0000-m del lustre.qpool2 00000040:00080000:2.0:1789896024.632695:0:213202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 182 count 178 00000020:01000000:1.0:1789896024.632731:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 178-181 (rc=0) 10000000:01000000:1.0:1789896024.632748:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789896024.632753:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a21bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.632765:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a21bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896024.632770:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789896024.632771:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:1.0:1789896024.632772:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789896024.632783:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.632787:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.632793:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.632801:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003526016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.632825:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.632846:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896024.632864:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003526016 00000100:00100000:3.0:1789896024.632868:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003526016 00000100:00100000:3.0:1789896024.632893:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:3.0:1789896024.632898:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003526016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896024.632903:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896024.632910:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a21ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a21c3 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896024.632921:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a21ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a21c3 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896024.632926:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a21ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a21c3 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896024.632930:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2c00, rc 0) 00000100:00100000:3.0:1789896024.632955:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003526016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 57us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896024.632960:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:1.0:1789896024.632969:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003526016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896024.632978:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a21ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.632985:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a21ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896024.633023:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003526144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896024.633047:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896024.633081:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948ed1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896024.633102:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003526144 00000100:00100000:0.0:1789896024.633106:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003526144 00000100:00100000:0.0:1789896024.633125:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:0.0:1789896024.633130:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003526144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896024.633170:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003526144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 41us (123us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789896024.633176:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00100000:1.0:1789896024.633181:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003526144:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789896024.633229:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789896024.633234:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a21ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896024.633239:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a21ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896025.068387:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896025.075571:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896025.075618:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015948032 00000100:00100000:3.0:1789896025.075626:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015948032 00000100:00100000:3.0:1789896025.075675:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2010 00000100:00100000:3.0:1789896025.075687:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015948032:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896025.075704:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896025.075719:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a21d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f5a6 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896025.075742:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a21d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5a6 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896025.075750:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a21d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5a6 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896025.075771:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2800, rc 0) 00000100:00100000:3.0:1789896025.075816:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015948032:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 134us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896025.075821:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2010 00000100:00100000:2.0:1789896025.076778:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896025.076816:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015948160 00000100:00100000:0.0:1789896025.076821:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015948160 00000100:00100000:0.0:1789896025.076849:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2011 00000100:00100000:0.0:1789896025.076854:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015948160:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896025.076960:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015948160:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 105us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896025.076965:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2011 00000100:00100000:0.0:1789896025.077567:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896025.077618:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015948288 00000100:00100000:3.0:1789896025.077629:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015948288 00000100:00100000:3.0:1789896025.077672:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2012 00000100:00100000:3.0:1789896025.077680:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015948288:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896025.077812:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015948288:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 132us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896025.077818:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2012 00000100:00100000:1.0:1789896025.078740:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896025.078773:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015948416 00000100:00100000:0.0:1789896025.078777:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015948416 00000100:00100000:0.0:1789896025.078808:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2013 00000100:00100000:0.0:1789896025.078816:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:212713:x1876838015948416:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789896025.078919:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:212713:x1876838015948416:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 102us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896025.078928:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2013 00000100:00100000:2.0:1789896025.079540:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896025.079583:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015948544 00000100:00100000:3.0:1789896025.079589:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015948544 00000100:00100000:3.0:1789896025.079622:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2014 00000100:00100000:3.0:1789896025.079632:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:212713:x1876838015948544:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789896025.079720:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:212713:x1876838015948544:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 89us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896025.079731:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2014 00000100:00100000:2.0:1789896025.080534:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896025.080566:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015948672 00000100:00100000:0.0:1789896025.080571:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015948672 00000100:00100000:0.0:1789896025.080604:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2015 00000100:00100000:0.0:1789896025.080612:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015948672:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896025.080619:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896025.080627:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a21d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f5ad expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.080639:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a21d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ad expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.080646:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a21d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ad expref: 10 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.080652:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5ba00, rc 0) 00000100:00100000:0.0:1789896025.080683:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015948672:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 73us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896025.080691:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2015 00000100:00100000:1.0:1789896025.081296:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896025.081321:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015948800 00000100:00100000:3.0:1789896025.081326:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015948800 00000100:00100000:3.0:1789896025.081348:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2016 00000100:00100000:3.0:1789896025.081353:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015948800:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896025.081408:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015948800:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 54us (114us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789896025.081425:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2016 00000100:00100000:3.0:1789896025.516447:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003526272:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789896025.516516:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896025.516577:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003526272 00000100:00100000:2.0:1789896025.516586:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003526272 00000100:00100000:2.0:1789896025.516640:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789896025.516652:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003526272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789896025.516686:0:188736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789896025.516737:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003526272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896025.516745:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789896025.516775:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003526272:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789896025.869253:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896025.869318:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015948928 00000100:00100000:0.0:1789896025.869330:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015948928 00000100:00080000:2.0:1789896025.869396:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789896025.869420:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2773 00000100:00100000:0.0:1789896025.869435:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:212740:x1876838015948928:12345-192.168.202.44@tcp:101:rm.0 00010000:00010000:0.0:1789896025.869461:0:192111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896025.869486:0:192111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a400/0x412fd4b3617a21df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f5b4 expref: -99 pid: 192111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869563:0:192111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b400/0x412fd4b3617a21e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869580:0:192111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b400/0x412fd4b3617a21e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869609:0:192111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b400/0x412fd4b3617a21e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869628:0:192111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a21ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869636:0:192111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a21ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869643:0:192111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a21ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869731:0:192111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5ae00/0x412fd4b3617a21f4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869740:0:192111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5ae00/0x412fd4b3617a21f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869746:0:192111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5ae00/0x412fd4b3617a21f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789896025.869796:0:192111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x81:0x0]: returning size 4096 00000004:00200000:0.0:1789896025.869800:0:192111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789896025.869822:0:192111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5ae00/0x412fd4b3617a21f4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869836:0:192111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b400/0x412fd4b3617a21e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869843:0:192111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b400/0x412fd4b3617a21e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869860:0:192111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b400/0x412fd4b3617a21e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869867:0:192111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b400 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:0.0:1789896025.869871:0:192111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b400/0x412fd4b3617a21e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869879:0:192111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b400/0x412fd4b3617a21e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869900:0:192111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa5210d000) 00010000:00010000:0.0:1789896025.869904:0:192111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789896025.869909:0:192111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b400/0x412fd4b3617a21e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869916:0:192111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b400/0x412fd4b3617a21e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869928:0:192111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a21ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869935:0:192111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a21ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869941:0:192111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a21ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869946:0:192111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b000 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:0.0:1789896025.869949:0:192111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a21ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869965:0:192111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a21ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869973:0:192111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x108d3aa5 (ffff91aa75c76f00) 00010000:00010000:0.0:1789896025.869975:0:192111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789896025.869979:0:192111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a21ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.869985:0:192111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a21ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.870015:0:192111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a400/0x412fd4b3617a21df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5b4 expref: 8 pid: 192111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.870029:0:192111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5ae00/0x412fd4b3617a21f4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5b4 expref: 7 pid: 192111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.870037:0:192111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x81:0x0].0x0 (ffff91aa75c76e00) 00010000:00010000:0.0:1789896025.870040:0:192111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789896025.870042:0:192111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5ae00, rc 0) 00000100:00100000:0.0:1789896025.870118:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+7:212740:x1876838015948928:12345-192.168.202.44@tcp:101:rm.0 Request processed in 687us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896025.870127:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2773 00000100:00100000:2.0:1789896025.871408:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896025.871459:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015949184 00000100:00100000:0.0:1789896025.871465:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015949184 00000100:00100000:0.0:1789896025.871503:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2774 00000100:00100000:0.0:1789896025.871510:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+7:212740:x1876838015949184:12345-192.168.202.44@tcp:101:rm.0 00010000:00010000:0.0:1789896025.871525:0:190608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896025.871532:0:190608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b800/0x412fd4b3617a21fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f5bb expref: -99 pid: 190608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789896025.871576:0:190608:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x81:0x0]: returning size 4096 00010000:00010000:0.0:1789896025.871681:0:190608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b800/0x412fd4b3617a21fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5bb expref: 9 pid: 190608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.871691:0:190608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa5210d000) 00010000:00010000:0.0:1789896025.871694:0:190608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789896025.871697:0:190608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b800/0x412fd4b3617a21fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5bb expref: 9 pid: 190608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.871708:0:190608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b800, rc 0) 00000100:00100000:0.0:1789896025.871743:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+8:212740:x1876838015949184:12345-192.168.202.44@tcp:101:rm.0 Request processed in 233us (338us total) trans 12884904334 rc 301/301 00000100:00100000:0.0:1789896025.871748:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2774 00000100:00100000:1.0:1789896025.873301:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896025.873341:0:189381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015949312 00000100:00100000:3.0:1789896025.873351:0:189381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015949312 00000100:00100000:3.0:1789896025.873404:0:189381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 191 00000100:00100000:3.0:1789896025.873414:0:189381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+8:212740:x1876838015949312:12345-192.168.202.44@tcp:37:rm.0 00000100:00100000:3.0:1789896025.875321:0:189381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+8:212740:x1876838015949312:12345-192.168.202.44@tcp:37:rm.0 Request processed in 1908us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896025.875330:0:189381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 191 00000100:00100000:2.0:1789896025.876619:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896025.876663:0:188734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015949568 00000100:00100000:0.0:1789896025.876669:0:188734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015949568 00000100:00100000:0.0:1789896025.876701:0:188734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 192 00000100:00100000:0.0:1789896025.876706:0:188734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+8:212740:x1876838015949568:12345-192.168.202.44@tcp:35:rm.0 00000100:00100000:0.0:1789896025.876870:0:188734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+9:212740:x1876838015949568:12345-192.168.202.44@tcp:35:rm.0 Request processed in 162us (252us total) trans 12884904335 rc 0/0 00000100:00100000:0.0:1789896025.876878:0:188734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 192 00000100:00100000:1.0:1789896025.877824:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896025.877865:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015949824 00000100:00100000:2.0:1789896025.877870:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015949824 00000100:00100000:2.0:1789896025.877900:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2775 00000100:00100000:2.0:1789896025.877905:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+9:212740:x1876838015949824:12345-192.168.202.44@tcp:36:rm.0 00010000:00010000:2.0:1789896025.877932:0:188730:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789896025.877957:0:188730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5ae00/0x412fd4b3617a21f4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x81:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5b4 expref: 9 pid: 192111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.877971:0:188730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x81:0x0].0x0 (ffff91aa75c76e00) 00010000:00010000:2.0:1789896025.877982:0:188730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9523c7200/0x412fd4b3617a1bf0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f51a expref: 8 pid: 192111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.877989:0:188730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa5210d000) 00010000:00010000:2.0:1789896025.877995:0:188730:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896025.878011:0:188730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2209 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878020:0:188730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2209 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878027:0:188730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2209 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878034:0:188730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9200/0x412fd4b3617a2210 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878038:0:188730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9200/0x412fd4b3617a2210 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878042:0:188730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9200/0x412fd4b3617a2210 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878096:0:188730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2217 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878101:0:188730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2217 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878110:0:188730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2217 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789896025.878327:0:188730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x81:0x0]: returning size 4096 00010000:00010000:2.0:1789896025.878339:0:188730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2217 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878354:0:188730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2217 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878361:0:188730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2217 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878367:0:188730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8400 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:2.0:1789896025.878370:0:188730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2217 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878375:0:188730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2217 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878382:0:188730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x81:0x0].0x0 (ffff91aa5c8d2800) 00010000:00010000:2.0:1789896025.878384:0:188730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789896025.878387:0:188730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2217 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878392:0:188730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2217 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x81:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878408:0:188730:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2209 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878420:0:188730:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2209 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878424:0:188730:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2209 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878427:0:188730:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9600 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:2.0:1789896025.878429:0:188730:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2209 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878433:0:188730:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2209 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878438:0:188730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa5c8d2500) 00010000:00010000:2.0:1789896025.878439:0:188730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789896025.878441:0:188730:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2209 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878445:0:188730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2209 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789896025.878452:0:188730:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 00000000ce383903 reply state 00000000daca8f72 transno 12884904336 ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9200/0x412fd4b3617a2210 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878460:0:188730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9200/0x412fd4b3617a2210 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896025.878465:0:188730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x108d3aa5 (ffff91aa5c8d2700) 00010000:00010000:2.0:1789896025.878466:0:188730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789896025.878468:0:188730:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789896025.878518:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+9:212740:x1876838015949824:12345-192.168.202.44@tcp:36:rm.0 Request processed in 613us (695us total) trans 12884904336 rc 0/0 00000100:00100000:2.0:1789896025.878523:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2775 00000001:00080000:0.0:1789896025.879411:0:188711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884904336 is committed 00010000:00010000:3.0:1789896025.879445:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9200/0x412fd4b3617a2210 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896025.879457:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9200/0x412fd4b3617a2210 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896025.879466:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9200/0x412fd4b3617a2210 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896025.879472:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9200 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:3.0:1789896025.879476:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9200/0x412fd4b3617a2210 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896025.879483:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9200/0x412fd4b3617a2210 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896025.879580:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x108d3aa5 (ffff91aa5c8d2700) 00010000:00010000:3.0:1789896025.879584:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789896025.879589:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9200/0x412fd4b3617a2210 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896025.879596:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9200/0x412fd4b3617a2210 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x108d3aa5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896025.879621:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896025.879658:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015949952 00000100:00100000:0.0:1789896025.879669:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015949952 00000100:00100000:0.0:1789896025.879701:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2776 00000100:00100000:0.0:1789896025.879708:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:211222:x1876838015949952:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789896025.879719:0:192111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896025.879732:0:192111:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a400/0x412fd4b3617a221e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f5c2 expref: -99 pid: 192111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.879770:0:192111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2225 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.879779:0:192111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.879788:0:192111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789896025.879812:0:192111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789896025.879816:0:192111:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789896025.879830:0:192111:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.879848:0:192111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a400/0x412fd4b3617a221e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5c2 expref: 7 pid: 192111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.879861:0:192111:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5c2 expref: 6 pid: 192111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.879869:0:192111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa655e6100) 00010000:00010000:0.0:1789896025.879871:0:192111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789896025.879873:0:192111:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b000, rc 0) 00000100:00100000:0.0:1789896025.879916:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:211222:x1876838015949952:12345-192.168.202.44@tcp:101:bash.0 Request processed in 208us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896025.879922:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2776 00000100:00100000:3.0:1789896025.880644:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896025.880688:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015950080 00000100:00100000:0.0:1789896025.880694:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015950080 00000100:00100000:0.0:1789896025.880726:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2777 00000100:00100000:0.0:1789896025.880734:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:211222:x1876838015950080:12345-192.168.202.44@tcp:101:bash.0 00010000:00010000:0.0:1789896025.880742:0:190608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896025.880751:0:190608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b400/0x412fd4b3617a222c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f5c9 expref: -99 pid: 190608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880781:0:190608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a800/0x412fd4b3617a2233 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880790:0:190608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a800/0x412fd4b3617a2233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880797:0:190608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a800/0x412fd4b3617a2233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880810:0:190608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b200/0x412fd4b3617a223a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880817:0:190608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b200/0x412fd4b3617a223a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880823:0:190608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b200/0x412fd4b3617a223a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880842:0:190608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a800/0x412fd4b3617a2233 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880856:0:190608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a800/0x412fd4b3617a2233 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880863:0:190608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a800/0x412fd4b3617a2233 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880868:0:190608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a800 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:0.0:1789896025.880873:0:190608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a800/0x412fd4b3617a2233 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880880:0:190608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a800/0x412fd4b3617a2233 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880889:0:190608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa655e6100) 00010000:00010000:0.0:1789896025.880892:0:190608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789896025.880896:0:190608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a800/0x412fd4b3617a2233 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880901:0:190608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a800/0x412fd4b3617a2233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880912:0:190608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b200/0x412fd4b3617a223a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880919:0:190608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b200/0x412fd4b3617a223a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880925:0:190608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b200/0x412fd4b3617a223a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880930:0:190608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b200 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:0.0:1789896025.880938:0:190608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b200/0x412fd4b3617a223a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880945:0:190608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b200/0x412fd4b3617a223a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880954:0:190608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3bd617dd (ffff91aa655e6c00) 00010000:00010000:0.0:1789896025.880957:0:190608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789896025.880960:0:190608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b200/0x412fd4b3617a223a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880966:0:190608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b200/0x412fd4b3617a223a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3bd617dd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880988:0:190608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b400/0x412fd4b3617a222c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5c9 expref: 7 pid: 190608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.880997:0:190608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa655e6100) 00010000:00010000:0.0:1789896025.880999:0:190608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789896025.881003:0:190608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b400/0x412fd4b3617a222c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5c9 expref: 7 pid: 190608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896025.881012:0:190608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b400, rc 0) 00000100:00100000:0.0:1789896025.881049:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:211222:x1876838015950080:12345-192.168.202.44@tcp:101:bash.0 Request processed in 317us (407us total) trans 0 rc 301/301 00000100:00100000:0.0:1789896025.881057:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2777 00010000:00010000:0.0:1789896026.092331:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896026.540391:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789896026.540416:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003526400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789896026.540501:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896026.540544:0:188735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003526400 00000100:00100000:2.0:1789896026.540550:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789896026.540553:0:188735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003526400 00000100:00100000:2.0:1789896026.540559:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003526528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789896026.540586:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896026.540613:0:188735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789896026.540631:0:188735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003526400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789896026.540674:0:188735:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445871616 avail 1299632128 00000100:00100000:0.0:1789896026.540742:0:188735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1876838003526400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896026.540751:0:188735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1789896026.541324:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003526528 00000100:00100000:3.0:1789896026.541330:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003526528 00000100:00080000:0.0:1789896026.541373:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789896026.541385:0:196139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789896026.541394:0:196139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003526528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789896026.541417:0:196139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896026.541462:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003526400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789896026.541470:0:196139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003526528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896026.541476:0:196139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789896026.541503:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003526528:0@lo:13:osp-pre-0-1.0 00000020:00000004:0.0:1789896026.972648:0:213426:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789896026.972659:0:213426:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:0.0:1789896026.986601:0:213434:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789896026.986611:0:213434:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1789896027.117429:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789896027.848566:0:213540:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3900156364947ns, next at 3819238265902ns, rc = 0 00080000:00080000:3.0:1789896027.848581:0:213540:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789896027.848658:0:213540:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3900156458372ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789896027.848662:0:213540:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1789896027.848720:0:213540:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3900156520845ns, next at 3746909153849ns, rc = 0 00080000:00080000:3.0:1789896027.848725:0:213540:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789896027.848776:0:213540:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3900156576908ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789896027.848781:0:213540:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789896027.849277:0:189463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 35 committed 00000004:00080000:2.0:1789896027.849382:0:188711:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 43 committed 00000004:00080000:0.0:1789896027.849671:0:189463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 35 committed 00000004:00080000:2.0:1789896027.849740:0:188711:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 41 committed 00010000:00010000:1.0:1789896028.140304:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896028.274145:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896028.274188:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015950208 00000100:00100000:2.0:1789896028.274215:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015950208 00000100:00080000:1.0:1789896028.274262:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789896028.274281:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2778 00000100:00100000:2.0:1789896028.274291:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213065:x1876838015950208:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:2.0:1789896028.276286:0:188730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:188730:1876838003526656:0@lo:106: 00000100:00100000:2.0:1789896028.276337:0:188730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896028.276373:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003526656 00000100:00100000:3.0:1789896028.276379:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003526656 00000100:00100000:2.0:1789896028.276412:0:188730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:188730:1876838003526784:0@lo:106: 00000100:00100000:3.0:1789896028.276425:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1789896028.276443:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:188730:x1876838003526656:12345-0@lo:106: 00000100:00100000:2.0:1789896028.276449:0:188730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896028.276459:0:188714:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff91a94e13aa00/0x412fd4b36179d5c6 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d5e2 expref: -99 pid: 191063 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896028.276468:0:188714:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff91a94e13aa00/0x412fd4b36179d5c6 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d5e2 expref: -99 pid: 191063 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896028.276474:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003526784 00000100:00100000:0.0:1789896028.276480:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003526784 00000100:00100000:2.0:1789896028.276487:0:188730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:188730:1876838003526912:0@lo:106: 00000100:00100000:0.0:1789896028.276517:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1789896028.276523:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:188730:x1876838003526656:12345-0@lo:106: Request processed in 83us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896028.276532:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa770e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0000+8:188730:x1876838003526784:12345-0@lo:106: 00000100:00100000:3.0:1789896028.276536:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1789896028.276537:0:188730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896028.276547:0:188715:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff91a953147200/0x412fd4b36179d502 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d510 expref: -99 pid: 190257 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896028.276558:0:188715:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff91a953147200/0x412fd4b36179d502 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d510 expref: -99 pid: 190257 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896028.276561:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003526912 00000100:00100000:3.0:1789896028.276566:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003526912 00000100:00100000:3.0:1789896028.276589:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1789896028.276593:0:188730:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:188730:1876838003527040:0@lo:106: 00000100:00100000:3.0:1789896028.276600:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:188730:x1876838003526912:12345-0@lo:106: 00010000:00010000:3.0:1789896028.276609:0:188714:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff91aa62296400/0x412fd4b36179d422 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d429 expref: -99 pid: 189483 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896028.276619:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa770e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0000+8:188730:x1876838003526784:12345-0@lo:106: Request processed in 91us (171us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896028.276620:0:188714:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff91aa62296400/0x412fd4b36179d422 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d429 expref: -99 pid: 189483 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896028.276633:0:188730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896028.276639:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1789896028.276655:0:188730:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94711c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896028.276681:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003527040 00000100:00100000:0.0:1789896028.276692:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003527040 00000100:00100000:2.0:1789896028.276693:0:188730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:188730:1876838003526656:0@lo:106: 00000100:00100000:3.0:1789896028.276699:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:188730:x1876838003526912:12345-0@lo:106: Request processed in 98us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896028.276708:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1789896028.276716:0:188730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:188730:1876838003526784:0@lo:106: 00000100:00100000:0.0:1789896028.276722:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1789896028.276732:0:188730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:188730:1876838003526912:0@lo:106: 00000100:00100000:0.0:1789896028.276734:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:188730:x1876838003527040:12345-0@lo:106: 00010000:00010000:0.0:1789896028.276746:0:188715:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff91a94b29c600/0x412fd4b36179d2e7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d318 expref: -99 pid: 188765 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896028.276755:0:188715:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff91a94b29c600/0x412fd4b36179d2e7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d318 expref: -99 pid: 188765 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896028.276808:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0000+7:188730:x1876838003527040:12345-0@lo:106: Request processed in 77us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896028.276818:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1789896028.276965:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876838003527296:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789896028.277020:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896028.277056:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876838003527808:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789896028.277086:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896028.277114:0:193049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003527296 00000100:00100000:2.0:1789896028.277117:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789896028.277119:0:193049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003527296 00000100:00100000:2.0:1789896028.277128:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876838003527424:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789896028.277170:0:193049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003527808 00000100:00100000:2.0:1789896028.277175:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896028.277176:0:193049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003527808 00000100:00100000:3.0:1789896028.277245:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876838003527168:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789896028.277275:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896028.277277:0:188733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003527424 00000100:00100000:2.0:1789896028.277283:0:188733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003527424 00000100:00100000:3.0:1789896028.277294:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876838003527680:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789896028.277312:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896028.277312:0:188733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003527168 00000100:00100000:2.0:1789896028.277317:0:188733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003527168 00000100:00100000:3.0:1789896028.277336:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789896028.277339:0:188733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003527680 00000100:00100000:3.0:1789896028.277343:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876838003527552:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789896028.277344:0:188733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003527680 00000100:00100000:3.0:1789896028.277371:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896028.277375:0:188733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1789896028.277385:0:188733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ea5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+9:3617:x1876838003527296:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789896028.277395:0:193049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003527552 00000100:00100000:0.0:1789896028.277400:0:193049:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003527552 00000100:00100000:3.0:1789896028.277409:0:189381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789896028.277419:0:189381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+12:3617:x1876838003527808:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789896028.277430:0:193049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789896028.277442:0:188733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ea5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0001_UUID+9:3617:x1876838003527296:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 58us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896028.277443:0:193049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0000_UUID+9:3617:x1876838003527424:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789896028.277454:0:188733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789896028.277467:0:189381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-MDT0000_UUID+12:3617:x1876838003527808:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 50us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896028.277473:0:189381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789896028.277495:0:189381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789896028.277496:0:193049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0000_UUID+9:3617:x1876838003527424:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 55us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896028.277507:0:189381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+8:3616:x1876838003527168:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789896028.277508:0:188733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789896028.277517:0:193049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789896028.277522:0:188733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3616:x1876838003527680:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789896028.277539:0:193049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789896028.277549:0:193049:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0000_UUID+8:3616:x1876838003527552:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789896028.277562:0:189381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-lwp-OST0001_UUID+8:3616:x1876838003527168:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 59us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896028.277569:0:189381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789896028.277577:0:188733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3616:x1876838003527680:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 57us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896028.277597:0:188733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789896028.277602:0:193049:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:lustre-MDT0000-lwp-OST0000_UUID+8:3616:x1876838003527552:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896028.277610:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876838003527552:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789896028.277615:0:193049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789896028.277627:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876838003527168:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789896028.277643:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876838003527680:0@lo:601:lquota_wb_lustr.0 00000100:00080000:0.0:1789896028.277651:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789896028.277658:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3617:1876838003527424:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789896028.277675:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3617:1876838003527808:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789896028.277689:0:188730:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:188730:1876838003527040:0@lo:106: 00000100:00100000:2.0:1789896028.277697:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3617:1876838003527296:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789896028.277760:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213065:x1876838015950208:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 3472us (3622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896028.277766:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2778 00000100:00100000:3.0:1789896028.293103:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896028.293150:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015950336 00000100:00100000:0.0:1789896028.293172:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015950336 00000100:00100000:0.0:1789896028.293248:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2779 00000100:00100000:0.0:1789896028.293260:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213068:x1876838015950336:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:1.0:1789896028.294713:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213068:x1876838015950336:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1453us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896028.294723:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2779 00000100:00100000:2.0:1789896028.309041:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896028.309090:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015950464 00000100:00100000:0.0:1789896028.309100:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015950464 00000100:00100000:0.0:1789896028.309164:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2780 00000100:00100000:0.0:1789896028.309177:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213071:x1876838015950464:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:2.0:1789896028.310887:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213071:x1876838015950464:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1710us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896028.310897:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2780 00000100:00100000:3.0:1789896028.327227:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896028.327273:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015950592 00000100:00100000:2.0:1789896028.327281:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015950592 00000100:00100000:2.0:1789896028.327327:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2781 00000100:00100000:2.0:1789896028.327335:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213074:x1876838015950592:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:2.0:1789896028.328886:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213074:x1876838015950592:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1551us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896028.328893:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2781 00000100:00100000:3.0:1789896028.342571:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896028.342641:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015950720 00000100:00100000:1.0:1789896028.342652:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015950720 00000100:00100000:1.0:1789896028.342707:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2782 00000100:00100000:1.0:1789896028.342717:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213077:x1876838015950720:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:1.0:1789896028.344307:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213077:x1876838015950720:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1590us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896028.344315:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2782 00000100:00100000:3.0:1789896028.350689:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896028.350738:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015950848 00000100:00100000:2.0:1789896028.350752:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015950848 00000100:00100000:2.0:1789896028.350793:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2783 00000100:00100000:2.0:1789896028.350803:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213078:x1876838015950848:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:2.0:1789896028.352234:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213078:x1876838015950848:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1432us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896028.352240:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2783 00000100:00100000:3.0:1789896028.359356:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896028.359406:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015950976 00000100:00100000:2.0:1789896028.359422:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015950976 00000100:00100000:2.0:1789896028.359466:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2784 00000100:00100000:2.0:1789896028.359472:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213079:x1876838015950976:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:2.0:1789896028.360930:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213079:x1876838015950976:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1454us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896028.360939:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2784 00000100:00100000:3.0:1789896028.367553:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896028.367630:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015951104 00000100:00100000:1.0:1789896028.367640:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015951104 00000100:00100000:1.0:1789896028.367696:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2785 00000100:00100000:1.0:1789896028.367707:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213080:x1876838015951104:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:1.0:1789896028.369175:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213080:x1876838015951104:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1468us (1625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896028.369184:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2785 00000100:00100000:3.0:1789896029.043642:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896029.043684:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896029.043692:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015951360 00000100:00100000:2.0:1789896029.043708:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015951360 00000100:00100000:0.0:1789896029.043736:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015951232 00000100:00100000:0.0:1789896029.043741:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015951232 00000100:00100000:0.0:1789896029.043779:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2017 00000100:00100000:2.0:1789896029.043782:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 490 00000100:00100000:2.0:1789896029.043789:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2403:x1876838015951360:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789896029.043789:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:2404:x1876838015951232:12345-192.168.202.44@tcp:400:kworker.0 00000100:00080000:1.0:1789896029.043792:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789896029.043854:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2403:x1876838015951360:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 65us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896029.043858:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:2404:x1876838015951232:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 71us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896029.043863:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 490 00000100:00100000:0.0:1789896029.043864:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2017 00010000:00010000:2.0:1789896029.164355:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896029.612326:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789896029.612343:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003528064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789896029.612351:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003527936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789896029.612352:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003528192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789896029.612411:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896029.612429:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003528448:0@lo:400:kworker.0 00000100:00100000:1.0:1789896029.612444:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003528064 00000100:00100000:1.0:1789896029.612452:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003528064 00000100:00100000:3.0:1789896029.612456:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003528576:0@lo:400:kworker.0 00000100:00100000:2.0:1789896029.612475:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896029.612490:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896029.612491:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896029.612506:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003528960:0@lo:400:kworker.0 00000100:00100000:1.0:1789896029.612510:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003528192 00000100:00100000:1.0:1789896029.612513:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003528192 00000100:00100000:3.0:1789896029.612519:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003529088:0@lo:400:kworker.0 00000100:00100000:1.0:1789896029.612539:0:190238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789896029.612539:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003528704:0@lo:400:kworker.0 00000100:00100000:2.0:1789896029.612549:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896029.612551:0:190238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003528064:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789896029.612559:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789896029.612581:0:190238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896029.612583:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876838003529472:0@lo:400:kworker.0 00000100:00100000:3.0:1789896029.612591:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876838003529600:0@lo:400:kworker.0 00000100:00100000:0.0:1789896029.612592:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896029.612628:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003529216:0@lo:400:kworker.0 00000100:00100000:2.0:1789896029.612631:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896029.612646:0:190238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003528064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896029.612647:0:196139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789896029.612661:0:196139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003528192:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789896029.612661:0:190238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789896029.612663:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1789896029.612672:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896029.612676:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003528320:0@lo:400:kworker.0 00002000:00000024:3.0:1789896029.612679:0:196139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789896029.612699:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003528576 00000100:00100000:0.0:1789896029.612700:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876838003529728:0@lo:400:kworker.0 00000100:00100000:1.0:1789896029.612703:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003528576 00000100:00100000:2.0:1789896029.612723:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896029.612729:0:196139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003528192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896029.612734:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003529088 00000100:00100000:3.0:1789896029.612738:0:196139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789896029.612739:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003529088 00000100:00100000:0.0:1789896029.612744:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896029.612769:0:190235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003528704 00000100:00100000:3.0:1789896029.612773:0:190235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003528704 00000100:00100000:1.0:1789896029.612774:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003529216 00000100:00100000:1.0:1789896029.612778:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003529216 00000100:00100000:2.0:1789896029.612785:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003528832:0@lo:400:kworker.0 00000100:00100000:3.0:1789896029.612801:0:190235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789896029.612810:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789896029.612811:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003528192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789896029.612814:0:190235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003528576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896029.612817:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896029.612824:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003529088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896029.612839:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876838003529344:0@lo:400:kworker.0 00000100:00100000:3.0:1789896029.612862:0:190235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003528576:12345-0@lo:400:kworker.0 Request processed in 54us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896029.612862:0:188735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003528448 00000100:00100000:3.0:1789896029.612870:0:190235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789896029.612875:0:188735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003528448 00000100:00100000:1.0:1789896029.612879:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950859f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003529088:12345-0@lo:400:kworker.0 Request processed in 57us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896029.612882:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896029.612888:0:190235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789896029.612902:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876838003529856:0@lo:400:kworker.0 00000100:00100000:1.0:1789896029.612902:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789896029.612911:0:190235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003528704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896029.612915:0:188735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003528960 00000100:00100000:0.0:1789896029.612920:0:188735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003528960 00000100:00100000:1.0:1789896029.612924:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789896029.612929:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896029.612936:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003529216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896029.612948:0:188735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789896029.612958:0:188735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003528448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896029.612962:0:190235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003528704:12345-0@lo:400:kworker.0 Request processed in 60us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896029.612968:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789896029.612973:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003529216:12345-0@lo:400:kworker.0 Request processed in 41us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896029.612975:0:190235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789896029.612980:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003528960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896029.612985:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789896029.613008:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003528320 00000100:00080000:1.0:1789896029.613008:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789896029.613014:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003528320 00000100:00080000:1.0:1789896029.613016:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789896029.613025:0:188735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003528448:12345-0@lo:400:kworker.0 Request processed in 67us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896029.613030:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003528960:12345-0@lo:400:kworker.0 Request processed in 53us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896029.613033:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003529472 00000100:00100000:0.0:1789896029.613036:0:188735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789896029.613042:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789896029.613046:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003529472 00000100:00100000:3.0:1789896029.613049:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2018 00000100:00100000:3.0:1789896029.613057:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3618:x1876838003528320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896029.613082:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003529728 00000100:00100000:1.0:1789896029.613084:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003528832 00000100:00100000:2.0:1789896029.613088:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896029.613088:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003529728 00000100:00100000:1.0:1789896029.613089:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003528832 00000100:00100000:3.0:1789896029.613093:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3618:x1876838003528320:12345-0@lo:400:kworker.0 Request processed in 36us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896029.613100:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2018 00000100:00100000:1.0:1789896029.613111:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003529344 00000100:00100000:1.0:1789896029.613114:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003529344 00000100:00100000:0.0:1789896029.613121:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003529856 00000100:00100000:2.0:1789896029.613124:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003528064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789896029.613127:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003529856 00000100:00100000:1.0:1789896029.613135:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003529600 00000100:00100000:1.0:1789896029.613138:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003529600 00000100:00100000:3.0:1789896029.613158:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1789896029.613162:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003528576:0@lo:400:kworker.0 00000100:00100000:3.0:1789896029.613168:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876838003529472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896029.613178:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003529088:0@lo:400:kworker.0 00000100:00100000:0.0:1789896029.613188:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1789896029.613196:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1789896029.613221:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876838003528832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896029.613222:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3616:x1876838003529728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896029.613229:0:188730:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1789896029.613237:0:188730:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:3.0:1789896029.613238:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876838003529472:12345-0@lo:400:kworker.0 Request processed in 71us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896029.613245:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:3.0:1789896029.613263:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1789896029.613271:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+8:3616:x1876838003529728:12345-0@lo:400:kworker.0 Request processed in 52us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896029.613273:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876838003529344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896029.613281:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876838003528832:12345-0@lo:400:kworker.0 Request processed in 83us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896029.613282:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1789896029.613293:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1789896029.613303:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1789896029.613315:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876838003529856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896029.613318:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1789896029.613323:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876838003529344:12345-0@lo:400:kworker.0 Request processed in 51us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896029.613336:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:2.0:1789896029.613336:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876838003529600:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789896029.613337:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789896029.613360:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876838003529856:12345-0@lo:400:kworker.0 Request processed in 49us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896029.613367:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896029.613368:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003528704:0@lo:400:kworker.0 00000100:00100000:1.0:1789896029.613371:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1789896029.613394:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003529216:0@lo:400:kworker.0 00000100:00100000:2.0:1789896029.613396:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876838003529600:12345-0@lo:400:kworker.0 Request processed in 65us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896029.613406:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003527936 00000100:00100000:2.0:1789896029.613407:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:3.0:1789896029.613412:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003527936 00000100:00100000:0.0:1789896029.613417:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3616:1876838003529728:0@lo:400:kworker.0 00000100:00100000:1.0:1789896029.613422:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003528320:0@lo:400:kworker.0 00000100:00100000:3.0:1789896029.613444:0:190238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00010000:00080000:2.0:1789896029.613449:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91aa58e1bb80 x1876838003529600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789896029.613452:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003528832:0@lo:400:kworker.0 00000100:00100000:3.0:1789896029.613455:0:190238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003527936:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789896029.613470:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876838003529344:0@lo:400:kworker.0 00010000:00080000:1.0:1789896029.613480:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a94ffbce00 x1876838003529856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:3.0:1789896029.613481:0:190238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896029.613485:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3615:1876838003529600:0@lo:400:kworker.0 00000100:00100000:1.0:1789896029.613498:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876838003529856:0@lo:400:kworker.0 00000100:00100000:1.0:1789896029.613510:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3618:1876838003529472:0@lo:400:kworker.0 00000100:00100000:1.0:1789896029.613522:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003528448:0@lo:400:kworker.0 00000100:00100000:3.0:1789896029.613528:0:190238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003527936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896029.613534:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003528960:0@lo:400:kworker.0 00000100:00100000:3.0:1789896029.613539:0:190238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789896029.613569:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003527936:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789896029.872453:0:213637:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-quota test 71b: Check SEL with quota pools ===== 05:20:28 (1789896028) 00010000:00010000:1.0:1789896030.188398:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896030.636349:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003529984:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789896030.636410:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896030.636442:0:188735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003529984 00000100:00100000:0.0:1789896030.636450:0:188735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003529984 00000100:00100000:0.0:1789896030.636501:0:188735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789896030.636509:0:188735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94691df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003529984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789896030.636548:0:188735:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789896030.636610:0:188735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94691df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003529984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896030.636617:0:188735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789896030.636639:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003529984:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1789896030.923860:0:213814:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789896030.923868:0:213814:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:1.0:1789896030.930994:0:213818:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789896030.931001:0:213818:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1789896030.944692:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896030.944739:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015951488 00000100:00100000:2.0:1789896030.944750:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015951488 00000100:00080000:3.0:1789896030.944782:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789896030.944806:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2786 00000100:00100000:2.0:1789896030.944815:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213374:x1876838015951488:12345-192.168.202.44@tcp:101:lfs.0 00010000:00010000:2.0:1789896030.944835:0:188731:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896030.944859:0:188731:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2241 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f5d0 expref: -99 pid: 188731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.944923:0:188731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2248 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.944936:0:188731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2248 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.944945:0:188731:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2248 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.944956:0:188731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9e00/0x412fd4b3617a224f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.944961:0:188731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9e00/0x412fd4b3617a224f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.944965:0:188731:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9e00/0x412fd4b3617a224f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.944999:0:188731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2248 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945011:0:188731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2248 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945016:0:188731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2248 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945020:0:188731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8400 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:2.0:1789896030.945023:0:188731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2248 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945029:0:188731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2248 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945038:0:188731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa655e6100) 00010000:00010000:2.0:1789896030.945040:0:188731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789896030.945044:0:188731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2248 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945048:0:188731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8400/0x412fd4b3617a2248 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945055:0:188731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9e00/0x412fd4b3617a224f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945060:0:188731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9e00/0x412fd4b3617a224f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945063:0:188731:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9e00/0x412fd4b3617a224f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945066:0:188731:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9e00 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:2.0:1789896030.945074:0:188731:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9e00/0x412fd4b3617a224f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945080:0:188731:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9e00/0x412fd4b3617a224f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945088:0:188731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff91aa5c8d2100) 00010000:00010000:2.0:1789896030.945091:0:188731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789896030.945093:0:188731:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9e00/0x412fd4b3617a224f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945100:0:188731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9e00/0x412fd4b3617a224f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 188731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945143:0:188731:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2241 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5d0 expref: 7 pid: 188731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945152:0:188731:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa655e6100) 00010000:00010000:2.0:1789896030.945154:0:188731:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789896030.945156:0:188731:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9600/0x412fd4b3617a2241 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5d0 expref: 7 pid: 188731 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.945163:0:188731:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9600, rc 0) 00000100:00100000:2.0:1789896030.945252:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213374:x1876838015951488:12345-192.168.202.44@tcp:101:lfs.0 Request processed in 438us (565us total) trans 0 rc 301/301 00000100:00100000:2.0:1789896030.945258:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2786 00000100:00100000:3.0:1789896030.946951:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896030.946989:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015951744 00000100:00100000:2.0:1789896030.946994:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015951744 00000100:00100000:2.0:1789896030.947024:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2787 00000100:00100000:2.0:1789896030.947033:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213374:x1876838015951744:12345-192.168.202.44@tcp:36:lfs.0 00010000:00010000:2.0:1789896030.947073:0:192111:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896030.947088:0:192111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b000/0x412fd4b3617a2225 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5c2 expref: 6 pid: 192111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947099:0:192111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa655e6100) 00010000:00010000:2.0:1789896030.947105:0:192111:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896030.947140:0:192111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9a00/0x412fd4b3617a2256 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947148:0:192111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9a00/0x412fd4b3617a2256 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947154:0:192111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9a00/0x412fd4b3617a2256 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947162:0:192111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a225d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947167:0:192111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a225d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947173:0:192111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a225d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947650:0:192111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9400/0x412fd4b3617a2264 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947657:0:192111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9400/0x412fd4b3617a2264 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947662:0:192111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9400/0x412fd4b3617a2264 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789896030.947677:0:192111:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 00000000bde56e28 reply state 00000000ac6cbbfa transno 12884904337 ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9400/0x412fd4b3617a2264 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947686:0:192111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9400/0x412fd4b3617a2264 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947690:0:192111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff91aa5c8d2800) 00010000:00010000:2.0:1789896030.947692:0:192111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789896030.947694:0:192111:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789896030.947697:0:192111:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00010000:00010000:2.0:1789896030.947703:0:192111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9a00/0x412fd4b3617a2256 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947708:0:192111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9a00/0x412fd4b3617a2256 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947712:0:192111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9a00/0x412fd4b3617a2256 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947716:0:192111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9a00 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:2.0:1789896030.947719:0:192111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9a00/0x412fd4b3617a2256 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947723:0:192111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9a00/0x412fd4b3617a2256 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947730:0:192111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa5c8d2600) 00010000:00010000:2.0:1789896030.947732:0:192111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789896030.947734:0:192111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9a00/0x412fd4b3617a2256 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947744:0:192111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9a00/0x412fd4b3617a2256 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789896030.947759:0:192111:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 00000000bde56e28 reply state 00000000ac6cbbfa transno 12884904337 ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a225d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947764:0:192111:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a225d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896030.947768:0:192111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff91aa5c8d2200) 00010000:00010000:2.0:1789896030.947770:0:192111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789896030.947772:0:192111:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789896030.947813:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+7:213374:x1876838015951744:12345-192.168.202.44@tcp:36:lfs.0 Request processed in 782us (863us total) trans 12884904337 rc 0/0 00000100:00100000:2.0:1789896030.947818:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2787 00000100:00100000:0.0:1789896030.951592:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896030.951634:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015951872 00000100:00100000:3.0:1789896030.951641:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015951872 00000100:00100000:3.0:1789896030.951683:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2788 00000100:00100000:3.0:1789896030.951695:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+7:213375:x1876838015951872:12345-192.168.202.44@tcp:101:chmod.0 00010000:00010000:3.0:1789896030.951713:0:188730:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896030.951732:0:188730:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2400/0x412fd4b3617a226b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f5d7 expref: -99 pid: 188730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896030.951778:0:188730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3400/0x412fd4b3617a2272 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896030.951790:0:188730:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3400/0x412fd4b3617a2272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896030.951800:0:188730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3400/0x412fd4b3617a2272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789896030.951831:0:188730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789896030.951835:0:188730:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789896030.951851:0:188730:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3400/0x412fd4b3617a2272 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188730 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896030.951881:0:188730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d2400/0x412fd4b3617a226b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5d7 expref: 9 pid: 188730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896030.951897:0:188730:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3400/0x412fd4b3617a2272 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5d7 expref: 8 pid: 188730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896030.951905:0:188730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa657f5e00) 00010000:00010000:3.0:1789896030.951908:0:188730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789896030.951910:0:188730:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3400, rc 0) 00000100:00100000:3.0:1789896030.951964:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+8:213375:x1876838015951872:12345-192.168.202.44@tcp:101:chmod.0 Request processed in 273us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896030.951971:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2788 00000100:00100000:3.0:1789896030.952784:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896030.952820:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015952000 00000100:00100000:0.0:1789896030.952826:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015952000 00000100:00100000:0.0:1789896030.952863:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2789 00000100:00100000:0.0:1789896030.952874:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+8:213375:x1876838015952000:12345-192.168.202.44@tcp:101:chmod.0 00010000:00010000:0.0:1789896030.952883:0:188732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896030.952895:0:188732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a2279 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f5de expref: -99 pid: 188732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.952928:0:188732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a200/0x412fd4b3617a2280 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.952938:0:188732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a200/0x412fd4b3617a2280 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.952946:0:188732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a200/0x412fd4b3617a2280 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.952958:0:188732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5be00/0x412fd4b3617a2287 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.952966:0:188732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5be00/0x412fd4b3617a2287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.952973:0:188732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5be00/0x412fd4b3617a2287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953038:0:188732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a600/0x412fd4b3617a228e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953046:0:188732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a600/0x412fd4b3617a228e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953054:0:188732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a600/0x412fd4b3617a228e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789896030.953074:0:188732:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00000004:00200000:0.0:1789896030.953077:0:188732:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789896030.953089:0:188732:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a600/0x412fd4b3617a228e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953099:0:188732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a200/0x412fd4b3617a2280 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953105:0:188732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a200/0x412fd4b3617a2280 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953112:0:188732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a200/0x412fd4b3617a2280 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953118:0:188732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a200 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:0.0:1789896030.953122:0:188732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a200/0x412fd4b3617a2280 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953141:0:188732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a200/0x412fd4b3617a2280 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953152:0:188732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91aa657f5e00) 00010000:00010000:0.0:1789896030.953161:0:188732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789896030.953166:0:188732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a200/0x412fd4b3617a2280 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953172:0:188732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a200/0x412fd4b3617a2280 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953182:0:188732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5be00/0x412fd4b3617a2287 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953189:0:188732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5be00/0x412fd4b3617a2287 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953195:0:188732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5be00/0x412fd4b3617a2287 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953222:0:188732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5be00 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:0.0:1789896030.953227:0:188732:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5be00/0x412fd4b3617a2287 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953234:0:188732:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5be00/0x412fd4b3617a2287 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953244:0:188732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff91aa5c8d2200) 00010000:00010000:0.0:1789896030.953247:0:188732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789896030.953251:0:188732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5be00/0x412fd4b3617a2287 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953257:0:188732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5be00/0x412fd4b3617a2287 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 188732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953279:0:188732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5b600/0x412fd4b3617a2279 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5de expref: 10 pid: 188732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953301:0:188732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a600/0x412fd4b3617a228e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5de expref: 9 pid: 188732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896030.953309:0:188732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff91aa5c8d2800) 00010000:00010000:0.0:1789896030.953312:0:188732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789896030.953315:0:188732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a600, rc 0) 00000100:00100000:0.0:1789896030.953349:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+9:213375:x1876838015952000:12345-192.168.202.44@tcp:101:chmod.0 Request processed in 478us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896030.953356:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2789 00000100:00100000:0.0:1789896030.954361:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896030.954386:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015952256 00000100:00100000:3.0:1789896030.954392:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015952256 00000100:00100000:3.0:1789896030.954432:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2790 00000100:00100000:3.0:1789896030.954440:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+9:213375:x1876838015952256:12345-192.168.202.44@tcp:36:chmod.0 00010000:00010000:3.0:1789896030.954468:0:190608:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896030.954482:0:190608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a948c5a600/0x412fd4b3617a228e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5de expref: 9 pid: 188732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896030.954494:0:190608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff91aa5c8d2800) 00010000:00010000:3.0:1789896030.954498:0:190608:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896030.954510:0:190608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3200/0x412fd4b3617a2295 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896030.954519:0:190608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3200/0x412fd4b3617a2295 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896030.954534:0:190608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3200/0x412fd4b3617a2295 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789896030.954644:0:190608:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 000000004aeca263 reply state 000000008c14719f transno 12884904338 ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3200/0x412fd4b3617a2295 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896030.954656:0:190608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3200/0x412fd4b3617a2295 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896030.954662:0:190608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff91aa5c8d2800) 00010000:00010000:3.0:1789896030.954664:0:190608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789896030.954668:0:190608:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789896030.954672:0:190608:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00000100:00100000:3.0:1789896030.954720:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+10:213375:x1876838015952256:12345-192.168.202.44@tcp:36:chmod.0 Request processed in 279us (356us total) trans 12884904338 rc 0/0 00000100:00100000:3.0:1789896030.954727:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2790 00010000:00010000:0.0:1789896031.212285:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789896031.622152:0:213926:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee0480f90 20000000:00000080:1.0:1789896031.622163:0:213926:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91aa65fa6400 uarg=0000000000000000 20000000:01000000:1.0:1789896031.622214:0:213926:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789896031.622217:0:213926:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789896031.622219:0:213926:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.ost=ugp' 20000000:01000000:1.0:1789896031.622223:0:213926:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'quota.ost=ugp' 20000000:01000000:1.0:1789896031.622228:0:213926:0:(mgs_llog.c:4246:mgs_write_log_quota()) global 'quota.ost=ugp' 20000000:01000000:1.0:1789896031.622274:0:213926:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789896031.622280:0:213926:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/quota.ost fl=4 20000000:01000000:1.0:1789896031.622520:0:213927:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 148 marker 135 1->4: lustre quota.ost 20000000:01000000:1.0:1789896031.622559:0:213927:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 150 marker 135 2->4: lustre quota.ost 00000040:00080000:1.0:1789896031.622571:0:213927:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 182 count 178 00000040:00080000:3.0:1789896031.622674:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].182, 224 off41408 00000040:00080000:3.0:1789896031.622690:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].183, 88 off41496 00000040:00080000:3.0:1789896031.622698:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].184, 224 off41720 20000000:01000000:3.0:1789896031.622704:0:213926:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789896031.622705:0:213926:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/quota.ost fl=4 20000000:01000000:1.0:1789896031.622897:0:213928:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 148 marker 136 1->4: lustre quota.ost 20000000:01000000:1.0:1789896031.622917:0:213928:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 150 marker 136 2->4: lustre quota.ost 00000040:00080000:1.0:1789896031.622937:0:213928:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 182 count 178 00000040:00080000:3.0:1789896031.623024:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].182, 224 off41408 00000040:00080000:3.0:1789896031.623038:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].183, 88 off41496 00000040:00080000:3.0:1789896031.623046:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].184, 224 off41720 20000000:01000000:3.0:1789896031.623052:0:213926:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789896031.623053:0:213926:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/quota.ost fl=4 20000000:01000000:1.0:1789896031.623525:0:213929:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 32 marker 137 1->4: lustre quota.ost 20000000:01000000:1.0:1789896031.623541:0:213929:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 34 marker 137 2->4: lustre quota.ost 00000040:00080000:1.0:1789896031.623547:0:213929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 35 count 35 00000040:00080000:3.0:1789896031.623609:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14456 00000040:00080000:3.0:1789896031.623621:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 88 off14544 00000040:00080000:3.0:1789896031.623628:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 224 off14768 20000000:01000000:3.0:1789896031.623635:0:213926:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789896031.623640:0:213926:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/quota.ost fl=4 20000000:01000000:1.0:1789896031.623793:0:213930:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 35 marker 138 1->4: lustre quota.ost 20000000:01000000:1.0:1789896031.623809:0:213930:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 37 marker 138 2->4: lustre quota.ost 00000040:00080000:1.0:1789896031.623815:0:213930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 38 count 38 00000040:00080000:3.0:1789896031.623881:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14984 00000040:00080000:3.0:1789896031.623903:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 88 off15072 00000040:00080000:3.0:1789896031.623917:0:213926:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15296 10000000:01000000:3.0:1789896031.623926:0:213926:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789896031.623941:0:213926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.623954:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a215a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2153 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.623959:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2161 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.623963:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a216f expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.623967:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a217d expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.623971:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a218b expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.623974:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a21a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2199 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.623979:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5aa00/0x412fd4b3617a21ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a21a7 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.623985:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a21bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a21b5 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.624001:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a21ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a21c3 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.624011:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a21d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5a6 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.624018:0:213926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a21d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ad expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.624025:0:213926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.624056:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a21d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ad expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.624065:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a21d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ad expref: 9 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.624076:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003530112:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789896031.624162:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a21d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5a6 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.624168:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a21d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5a6 expref: 9 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.624174:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003530240:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789896031.624217:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a21ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a21c3 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.624231:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a21ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a21c3 expref: 23 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.624238:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003530368:0@lo:104: 00000100:00100000:3.0:1789896031.624267:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896031.624291:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003530368 00000100:00100000:1.0:1789896031.624298:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003530368 00010000:00010000:3.0:1789896031.624305:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a21bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a21b5 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.624315:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a21bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a21b5 expref: 23 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.624324:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003530496:0@lo:104: 00000100:00100000:1.0:1789896031.624342:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1789896031.624355:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213926:x1876838003530368:12345-0@lo:104: 00010000:00010000:1.0:1789896031.624368:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a21ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.624411:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896031.624428:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789896031.624434:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213926:x1876838003530368:12345-0@lo:104: Request processed in 83us (166us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896031.624437:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5aa00/0x412fd4b3617a21ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a21a7 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.624444:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1789896031.624446:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003530496 00010000:00010000:3.0:1789896031.624447:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5aa00/0x412fd4b3617a21ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a21a7 expref: 23 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.624452:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003530496 00000100:00100000:3.0:1789896031.624457:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003530624:0@lo:104: 00010000:00010000:2.0:1789896031.624462:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789896031.624468:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a21ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.624476:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7400 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896031.624480:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a21ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.624481:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896031.624490:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a21ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.624492:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003530624 00000100:00100000:0.0:1789896031.624498:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003530624 10000000:00010000:2.0:1789896031.624499:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a21ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.624502:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00010000:00010000:3.0:1789896031.624508:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a21a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2199 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.624516:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213926:x1876838003530496:12345-0@lo:104: 00010000:00010000:3.0:1789896031.624520:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a21a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2199 expref: 23 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896031.624524:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896031.624525:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00010000:00010000:1.0:1789896031.624529:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a21bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.624539:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213926:x1876838003530624:12345-0@lo:104: 00000100:00100000:3.0:1789896031.624545:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003530752:0@lo:104: 00010000:00010000:0.0:1789896031.624551:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a21ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.624560:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a21ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.624566:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896031.624580:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789896031.624586:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a21ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.624595:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213926:x1876838003530496:12345-0@lo:104: Request processed in 81us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896031.624596:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896031.624600:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7400/0x412fd4b3617a21c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a21ca expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.624604:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789896031.624609:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1789896031.624614:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213926:x1876838003530624:12345-0@lo:104: Request processed in 78us (132us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896031.624617:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789896031.624620:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a21bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.624623:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00010000:00010000:3.0:1789896031.624627:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a218b expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.624632:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6200 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:1.0:1789896031.624632:0:189482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 10000000:00010000:2.0:1789896031.624637:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a21bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.624640:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003530752 00000100:00100000:1.0:1789896031.624644:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003530752 00010000:00010000:3.0:1789896031.624645:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a218b expref: 23 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.624647:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a21bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.624652:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 10000000:00010000:2.0:1789896031.624665:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a21bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.624666:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003531008:0@lo:104: 00000100:00100000:0.0:1789896031.624667:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003530880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896031.624670:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 10000000:01000000:2.0:1789896031.624679:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896031.624680:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa654f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213926:x1876838003530752:12345-0@lo:104: 00010000:00010000:1.0:1789896031.624693:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a21a0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.624703:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a21bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.624711:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896031.624717:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896031.624726:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789896031.624730:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a21bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.624731:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa654f9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:213926:x1876838003530752:12345-0@lo:104: Request processed in 51us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896031.624744:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00010000:00010000:2.0:1789896031.624746:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6200/0x412fd4b3617a21b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a21bc expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.624753:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003531136:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896031.624760:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789896031.624764:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a21ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.624771:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7e00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896031.624775:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a21ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.624780:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789896031.624785:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a21a0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.624792:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896031.624795:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896031.624798:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a21ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.624803:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7800 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896031.624808:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a21a0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896031.624809:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a21ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896031.624823:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896031.624824:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a21a0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896031.624830:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a21a0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.624832:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a217d expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.624837:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789896031.624838:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896031.624850:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2184 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a217d expref: 23 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.624850:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003530880 00010000:00010000:2.0:1789896031.624853:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a21ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.624855:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003530880 00010000:00010000:1.0:1789896031.624861:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a21a0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.624870:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789896031.624872:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003531264:0@lo:104: 00010000:00010000:0.0:1789896031.624874:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a21ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a21c3 expref: 24 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.624875:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896031.624887:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a21ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.624889:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a21a0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.624898:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003531136 00010000:00010000:2.0:1789896031.624901:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7e00/0x412fd4b3617a21a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a21ae expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.624903:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003531136 00010000:00010000:1.0:1789896031.624905:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7800/0x412fd4b3617a2199 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a21a0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.624914:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896031.624915:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a21bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a21b5 expref: 25 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.624928:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896031.624933:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896031.624936:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896031.624941:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896031.624944:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a216f expref: 25 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.624946:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896031.624946:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896031.624951:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896031.624951:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00010000:00010000:3.0:1789896031.624960:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a216f expref: 25 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.624961:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3616:x1876838003530880:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896031.624964:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003531008 00000100:00100000:1.0:1789896031.624969:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003531008 00000100:00100000:2.0:1789896031.624976:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003531520:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896031.624976:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789896031.624983:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003531648:0@lo:104: 00010000:00010000:0.0:1789896031.624984:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a21ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a21c3 expref: 25 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.624987:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003531264 00000100:00100000:1.0:1789896031.624991:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003531264 00010000:00010000:0.0:1789896031.625000:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a21ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a21c3 expref: 25 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.625010:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00010000:00010000:0.0:1789896031.625013:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896031.625018:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213926:x1876838003531008:12345-0@lo:104: 00010000:00010000:1.0:1789896031.625024:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2192 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896031.625025:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896031.625033:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896031.625057:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3616:x1876838003530880:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896031.625064:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00010000:00010000:3.0:1789896031.625068:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2161 expref: 25 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896031.625069:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789896031.625076:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003531520 00000100:00100000:0.0:1789896031.625080:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003531520 00010000:00010000:3.0:1789896031.625084:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2161 expref: 24 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896031.625084:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003531392:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896031.625085:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789896031.625097:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213926:x1876838003531008:12345-0@lo:104: Request processed in 79us (309us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896031.625098:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a21a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2199 expref: 25 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.625115:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1789896031.625136:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896031.625149:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003531648 00000100:00100000:0.0:1789896031.625150:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003531392 00000100:00100000:1.0:1789896031.625154:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003531648 00000100:00100000:0.0:1789896031.625156:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003531392 00000100:00100000:2.0:1789896031.625172:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00010000:00010000:0.0:1789896031.625177:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5aa00/0x412fd4b3617a21ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a21a7 expref: 26 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.625182:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1789896031.625185:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3616:x1876838003531136:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896031.625187:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003531776:0@lo:104: 00000100:00100000:1.0:1789896031.625219:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213926:x1876838003531264:12345-0@lo:104: 00010000:00010000:2.0:1789896031.625224:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896031.625232:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a21bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a21b5 expref: 26 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.625237:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896031.625239:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2184 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.625239:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00010000:00010000:2.0:1789896031.625254:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a21bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a21b5 expref: 26 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.625254:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3618:x1876838003531520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896031.625267:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896031.625271:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896031.625273:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a21a0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2199 expref: 26 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.625276:0:213926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a215a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2153 expref: 26 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.625289:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789896031.625290:0:213926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a215a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2153 expref: 26 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.625299:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213926:x1876838003531264:12345-0@lo:104: Request processed in 104us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896031.625301:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3616:x1876838003531136:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896031.625303:0:213926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003531904:0@lo:104: 00010000:00010000:0.0:1789896031.625303:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a21a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2199 expref: 26 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896031.625319:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:1.0:1789896031.625321:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00010000:00010000:0.0:1789896031.625326:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896031.625333:0:213926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896031.625339:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1789896031.625344:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003531776 00000100:00100000:3.0:1789896031.625347:0:213926:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d36f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896031.625348:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003531392:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896031.625349:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003531776 00010000:00010000:2.0:1789896031.625359:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896031.625363:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5aa00/0x412fd4b3617a21ae lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a21a7 expref: 25 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.625368:0:213926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a21ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a21c3 expref: 25 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.625370:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003531904 00000100:00100000:0.0:1789896031.625374:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003531520:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896031.625375:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003531904 00010000:00010000:2.0:1789896031.625389:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5aa00/0x412fd4b3617a21ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a21a7 expref: 25 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.625390:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1789896031.625394:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00010000:00010000:2.0:1789896031.625407:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896031.625407:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:213926:x1876838003531648:12345-0@lo:104: 00010000:00010000:1.0:1789896031.625420:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2176 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.625424:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003530368:0@lo:104: 00010000:00010000:0.0:1789896031.625427:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789896031.625434:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2192 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896031.625436:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a52850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3618:x1876838003531392:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (313us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896031.625442:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7c00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:3.0:1789896031.625444:0:213926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a21bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a21b5 expref: 23 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896031.625448:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2192 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896031.625454:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:3.0:1789896031.625460:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003530496:0@lo:104: 00010000:00010000:0.0:1789896031.625466:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2192 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.625470:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789896031.625475:0:213926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5aa00/0x412fd4b3617a21ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a21a7 expref: 21 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.625483:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:213926:x1876838003531648:12345-0@lo:104: Request processed in 77us (453us total) trans 0 rc 0/0 10000000:00010000:0.0:1789896031.625489:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2192 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896031.625499:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896031.625503:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:3.0:1789896031.625508:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003530624:0@lo:104: 00010000:00010000:0.0:1789896031.625522:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2192 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.625528:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00010000:00010000:3.0:1789896031.625530:0:213926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5ac00/0x412fd4b3617a21a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2199 expref: 20 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.625531:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896031.625540:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1789896031.625543:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213926:x1876838003531776:12345-0@lo:104: 00010000:00010000:0.0:1789896031.625544:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2192 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.625554:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003530752:0@lo:104: 00000100:00100000:2.0:1789896031.625555:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213926:x1876838003531904:12345-0@lo:104: 00010000:00010000:0.0:1789896031.625559:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a218b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2192 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.625560:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2168 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.625563:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a215a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.625581:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789896031.625583:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003531008:0@lo:104: 00010000:00010000:0.0:1789896031.625585:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2184 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.625591:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7a00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896031.625593:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2184 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.625596:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003531264:0@lo:104: 00010000:00010000:0.0:1789896031.625604:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2184 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896031.625610:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2184 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896031.625614:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789896031.625615:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003531648:0@lo:104: 00010000:00010000:1.0:1789896031.625622:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789896031.625628:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213926:x1876838003531776:12345-0@lo:104: Request processed in 90us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896031.625633:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003531776:0@lo:104: 00010000:00010000:0.0:1789896031.625635:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2184 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.625641:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789896031.625650:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003531904:0@lo:104: 00010000:00010000:0.0:1789896031.625651:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896031.625653:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:213926:x1876838003531904:12345-0@lo:104: Request processed in 102us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896031.625654:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00010000:00010000:0.0:1789896031.625660:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2184 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.625667:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a217d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2184 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896031.625669:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00010000:00010000:1.0:1789896031.625675:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789896031.625680:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2176 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.625681:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789896031.625687:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2168 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.625689:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6400 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896031.625692:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:1.0:1789896031.625695:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2176 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.625695:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6800 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896031.625697:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a215a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896031.625700:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2168 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.625716:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2176 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.625718:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7600 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:0.0:1789896031.625719:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2168 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896031.625725:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a215a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896031.625726:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2176 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896031.625728:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2168 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.625745:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a215a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896031.625745:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789896031.625746:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1789896031.625757:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a215a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.625764:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2176 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.625766:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2168 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.625783:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896031.625783:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1789896031.625784:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896031.625800:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2168 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.625801:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2176 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.625806:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a215a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.625813:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003532288:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896031.625820:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6400/0x412fd4b3617a216f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2176 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.625827:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896031.625835:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a215a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.625837:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a2161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2168 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.625841:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896031.625845:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896031.625848:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a2153 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a215a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.625849:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896031.625856:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896031.625856:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896031.625859:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896031.625860:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896031.625865:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896031.625870:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896031.625873:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896031.625877:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896031.625879:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003532288 00000100:00100000:0.0:1789896031.625883:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003532288 00000100:00100000:3.0:1789896031.625884:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789896031.625890:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003532416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896031.625897:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a216f expref: 20 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.625909:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896031.625919:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003532416 00000100:00100000:0.0:1789896031.625922:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003532416 00000100:00100000:1.0:1789896031.625931:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00010000:00010000:0.0:1789896031.625935:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2161 expref: 21 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.625942:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3617:x1876838003532288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896031.625949:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896031.625954:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a216f expref: 21 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.625957:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00010000:00010000:1.0:1789896031.625968:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a216f expref: 21 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.625972:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3617:x1876838003532416:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896031.625983:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:1.0:1789896031.625986:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a216f expref: 21 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.625986:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896031.625994:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2161 expref: 21 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896031.625997:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896031.626002:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2161 expref: 20 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896031.626006:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003530112:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789896031.626015:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2161 expref: 20 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896031.626022:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896031.626023:0:213926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:213926:1876838003530240:192.168.202.44@tcp:104: 00010000:00010000:0.0:1789896031.626030:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896031.626031:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3617:x1876838003532288:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896031.626038:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:1.0:1789896031.626061:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015952512 00000100:00100000:1.0:1789896031.626064:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015952512 00000100:00100000:0.0:1789896031.626073:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3617:x1876838003532416:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896031.626077:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003532160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896031.626078:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a21d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5a6 expref: 10 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.626084:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00010000:00010000:3.0:1789896031.626085:0:213926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.626105:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015952384 00000100:00100000:0.0:1789896031.626109:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015952384 00000100:00100000:2.0:1789896031.626113:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896031.626113:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 477 00010000:00010000:0.0:1789896031.626137:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a21d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ad expref: 11 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.626138:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015952512:12345-192.168.202.44@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789896031.626149:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003531136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896031.626151:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896031.626157:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a21d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5a6 expref: 11 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.626161:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003532160 00000100:00100000:2.0:1789896031.626162:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003530880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896031.626166:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003532160 00010000:00010000:1.0:1789896031.626171:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a21d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5a6 expref: 11 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.626180:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2184 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a217d expref: 18 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896031.626183:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789896031.626192:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003532032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896031.626221:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 478 00000100:00100000:0.0:1789896031.626234:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015952384:12345-192.168.202.44@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789896031.626236:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896031.626245:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896031.626250:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a21d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ad expref: 11 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.626260:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a21d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ad expref: 11 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896031.626265:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003532544:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896031.626272:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5ba00/0x412fd4b3617a21d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ad expref: 11 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.626282:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896031.626285:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896031.626308:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003532032 00000100:00100000:0.0:1789896031.626310:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+10:2403:x1876838015952384:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896031.626318:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003532032 00000100:00100000:0.0:1789896031.626322:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 478 00010000:00010000:2.0:1789896031.626334:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a218b expref: 19 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.626353:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003532544 00000100:00100000:2.0:1789896031.626358:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1789896031.626360:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003532544 00000100:00100000:2.0:1789896031.626367:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3616:x1876838003532160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896031.626375:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896031.626377:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a215a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2153 expref: 20 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.626380:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2184 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a217d expref: 20 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.626396:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a217d expref: 20 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.626404:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00010000:00010000:2.0:1789896031.626406:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a217d expref: 20 pid: 188723 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.626413:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3616:x1876838003532032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896031.626415:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896031.626419:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896031.626424:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a218b expref: 19 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.626432:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a218b expref: 19 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896031.626441:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a218b expref: 19 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896031.626451:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:3616:x1876838003532160:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (339us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896031.626452:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896031.626459:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:3.0:1789896031.626467:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003532160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896031.626475:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a21d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5a6 expref: 11 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896031.626481:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1789896031.626486:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:3616:x1876838003532032:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (254us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896031.626488:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896031.626492:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003532032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896031.626494:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:2.0:1789896031.626495:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:3616:x1876838003532544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896031.626505:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896031.626511:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a215a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2153 expref: 16 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.626513:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6f6720b-db77-464e-82b6-5f314c431303+8:2403:x1876838015952512:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 389us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896031.626527:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 477 00010000:00010000:2.0:1789896031.626530:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a215a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2153 expref: 16 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.626540:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a215a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2153 expref: 16 pid: 188725 timeout: 4003 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.626556:0:188717:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.626560:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003532416:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896031.626564:0:188717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896031.626573:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003532288:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896031.626574:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896031.626575:0:188717:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.626582:0:188717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.626588:0:188717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.626595:0:188717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.626601:0:188717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2400 already unused, calling callback (ffffffffc0c2e250) 00000100:00100000:0.0:1789896031.626601:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003531392:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896031.626609:0:188717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896031.626611:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003531520:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896031.626623:0:188717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.626640:0:188717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896031.626648:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896031.626653:0:213926:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.626659:0:213926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896031.626664:0:213926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a229c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 213926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896031.626676:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3616:x1876838003532544:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896031.626688:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1789896031.626704:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003532544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896031.660314:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003532672:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789896031.660382:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896031.660428:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003532672 00000100:00100000:3.0:1789896031.660434:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003532672 00000100:00100000:3.0:1789896031.660483:0:196139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789896031.660490:0:196139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003532672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789896031.660518:0:196139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789896031.660530:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789896031.660544:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003532800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789896031.660558:0:196139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003532672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896031.660565:0:196139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00080000:3.0:1789896031.660588:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789896031.660592:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896031.660624:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003532672:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789896031.660634:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003532800 00000100:00100000:0.0:1789896031.660638:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003532800 00000100:00100000:0.0:1789896031.660669:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789896031.660677:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003532800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789896031.660699:0:192489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445871616 avail 1299632128 00000100:00100000:0.0:1789896031.660747:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003532800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896031.660755:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789896031.660760:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003532800:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789896032.237286:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896033.139609:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896033.139661:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015952640 00000100:00100000:3.0:1789896033.139672:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015952640 00000100:00100000:3.0:1789896033.139727:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2019 00000100:00100000:3.0:1789896033.139737:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015952640:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896033.139754:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896033.139781:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f5e5 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.139809:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5e5 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.139821:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5e5 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.139844:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3800, rc 0) 00000100:00100000:3.0:1789896033.139909:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015952640:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 174us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.139916:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2019 00000100:00100000:0.0:1789896033.140849:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896033.140898:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015952768 00000100:00100000:3.0:1789896033.140903:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015952768 00000100:00100000:3.0:1789896033.140931:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2020 00000100:00100000:3.0:1789896033.140938:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015952768:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.141053:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015952768:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 115us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.141060:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2020 00000100:00100000:2.0:1789896033.141744:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896033.141791:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015952896 00000100:00100000:3.0:1789896033.141798:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015952896 00000100:00100000:3.0:1789896033.141829:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2021 00000100:00100000:3.0:1789896033.141835:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015952896:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.141919:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015952896:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 82us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.141926:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2021 00000100:00100000:0.0:1789896033.143351:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896033.143389:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015953024 00000100:00100000:3.0:1789896033.143427:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015953024 00000100:00100000:3.0:1789896033.143456:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2022 00000100:00100000:3.0:1789896033.143465:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015953024:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896033.143473:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896033.143486:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f5ec expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.143512:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ec expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.143523:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ec expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.143531:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3a00, rc 0) 00000100:00100000:3.0:1789896033.143561:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015953024:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 98us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.143569:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2022 00000100:00100000:0.0:1789896033.144240:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896033.144279:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015953152 00000100:00100000:3.0:1789896033.144285:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015953152 00000100:00100000:3.0:1789896033.144311:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2023 00000100:00100000:3.0:1789896033.144318:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015953152:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.144367:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015953152:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 49us (126us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789896033.144375:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2023 00000001:02000400:0.0:1789896033.219975:0:214170:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: User quota (block hardlimit:1000 MB) 00000100:00100000:2.0:1789896033.237417:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896033.237466:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015953280 00000100:00100000:0.0:1789896033.237478:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015953280 00000100:00080000:3.0:1789896033.237526:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789896033.237541:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2791 00000100:00100000:0.0:1789896033.237549:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+10:213654:x1876838015953280:12345-192.168.202.44@tcp:48:lfs.0 00000001:00080000:3.0:1789896033.238625:0:188711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884904338 is committed 00010000:00010000:2.0:1789896033.238657:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a225d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238666:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a225d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238672:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a225d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238677:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8600 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:2.0:1789896033.238680:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a225d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238685:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a225d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238700:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff91aa5c8d2200) 00010000:00010000:2.0:1789896033.238702:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789896033.238705:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a225d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238710:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e8600/0x412fd4b3617a225d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238725:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9400/0x412fd4b3617a2264 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238729:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9400/0x412fd4b3617a2264 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238739:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9400/0x412fd4b3617a2264 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238743:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9400 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:2.0:1789896033.238745:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9400/0x412fd4b3617a2264 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238749:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9400/0x412fd4b3617a2264 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238755:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff91aa5c8d2800) 00010000:00010000:2.0:1789896033.238756:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789896033.238758:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9400/0x412fd4b3617a2264 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238762:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91aa654e9400/0x412fd4b3617a2264 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192111 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238771:0:3602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3200/0x412fd4b3617a2295 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238775:0:3602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3200/0x412fd4b3617a2295 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238779:0:3602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3200/0x412fd4b3617a2295 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238783:0:3602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3200 already unused, calling callback (ffffffffc18356d0) 00010000:00010000:2.0:1789896033.238784:0:3602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3200/0x412fd4b3617a2295 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238795:0:3602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3200/0x412fd4b3617a2295 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238801:0:3602:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff91aa5c8d2800) 00010000:00010000:2.0:1789896033.238802:0:3602:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789896033.238804:0:3602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3200/0x412fd4b3617a2295 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.238808:0:3602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91a9512d3200/0x412fd4b3617a2295 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x82:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190608 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896033.239415:0:213600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213600:1876838003532928:0@lo:106: 00000100:00100000:0.0:1789896033.239466:0:213600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896033.239505:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003532928 00000100:00100000:2.0:1789896033.239509:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003532928 00000100:00100000:0.0:1789896033.239514:0:213600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213600:1876838003533056:0@lo:106: 00000100:00100000:0.0:1789896033.239535:0:213600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896033.239557:0:189482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789896033.239559:0:213600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213600:1876838003533184:0@lo:106: 00000100:00100000:3.0:1789896033.239567:0:200085:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/3 left), rc = 0 00000100:00100000:2.0:1789896033.239575:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003533056 00000100:00100000:2.0:1789896033.239580:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003533056 00000100:00100000:3.0:1789896033.239589:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1789896033.239590:0:213600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896033.239603:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0001+8:213600:x1876838003532928:12345-0@lo:106: 00000100:00100000:2.0:1789896033.239612:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003533184 00010000:00010000:3.0:1789896033.239616:0:200085:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff91a94e13aa00/0x412fd4b36179d5c6 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d5e2 expref: -99 pid: 191063 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896033.239617:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003533184 00000100:00100000:0.0:1789896033.239626:0:213600:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213600:1876838003533312:0@lo:106: 00010000:00010000:3.0:1789896033.239630:0:200085:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff91a94e13aa00/0x412fd4b36179d5c6 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d5e2 expref: -99 pid: 191063 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896033.239640:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1789896033.239651:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fa5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:213600:x1876838003533056:12345-0@lo:106: 00000100:00100000:0.0:1789896033.239659:0:213600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896033.239663:0:189482:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff91a953147200/0x412fd4b36179d502 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d510 expref: -99 pid: 190257 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.239674:0:189482:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff91a953147200/0x412fd4b36179d502 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d510 expref: -99 pid: 190257 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896033.239678:0:213600:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a95215c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789896033.239698:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003533312 00000100:00100000:0.0:1789896033.239707:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003533312 00000100:00100000:3.0:1789896033.239712:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-OST0001+8:213600:x1876838003532928:12345-0@lo:106: Request processed in 110us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.239721:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:2.0:1789896033.239729:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fa5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:213600:x1876838003533056:12345-0@lo:106: Request processed in 80us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896033.239736:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1789896033.239749:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1789896033.239757:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1789896033.239762:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d544380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0001+9:213600:x1876838003533184:12345-0@lo:106: 00000100:00100000:3.0:1789896033.239770:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:213600:x1876838003533312:12345-0@lo:106: 00010000:00010000:0.0:1789896033.239772:0:188715:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff91aa62296400/0x412fd4b36179d422 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d429 expref: -99 pid: 189483 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.239781:0:188715:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff91aa62296400/0x412fd4b36179d422 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d429 expref: -99 pid: 189483 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.239782:0:200085:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff91a94b29c600/0x412fd4b36179d2e7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d318 expref: -99 pid: 188765 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.239796:0:200085:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff91a94b29c600/0x412fd4b36179d2e7 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b36179d318 expref: -99 pid: 188765 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896033.239845:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d544380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-MDT0001+9:213600:x1876838003533184:12345-0@lo:106: Request processed in 87us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896033.239852:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1789896033.239856:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:lustre-MDT0000-lwp-MDT0000+7:213600:x1876838003533312:12345-0@lo:106: Request processed in 88us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.239865:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1789896033.240051:0:213600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213600:1876838003532928:0@lo:106: 00000100:00100000:0.0:1789896033.240066:0:213600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbce00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213600:1876838003533056:0@lo:106: 00000100:00100000:0.0:1789896033.240078:0:213600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213600:1876838003533184:0@lo:106: 00000100:00100000:0.0:1789896033.240087:0:213600:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:213600:1876838003533312:0@lo:106: 00000100:00100000:0.0:1789896033.240174:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213654:x1876838015953280:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 2623us (2765us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896033.240182:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2791 00010000:00010000:1.0:1789896033.261287:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789896033.494288:0:214218:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffec0672a20 20000000:00000080:1.0:1789896033.494303:0:214218:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91aa65fa7000 uarg=0000000000000000 00000040:00100000:1.0:1789896033.494851:0:214218:0:(llog.c:1072:llog_reverse_process()) index 158 : idx 137 20000000:01000000:1.0:1789896033.494858:0:214218:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 151 cmd:0xce023 lustre.qpool1 00000040:00080000:1.0:1789896033.494932:0:214218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].159, 224 off37176 20000000:01000000:1.0:1789896033.494950:0:214218:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:1.0:1789896033.494963:0:214218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].160, 104 off37280 00000040:00080000:1.0:1789896033.494976:0:214218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].161, 224 off37504 00000040:00080000:1.0:1789896033.495028:0:214218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].185, 224 off41944 20000000:01000000:1.0:1789896033.495035:0:214218:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:1.0:1789896033.495046:0:214218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].186, 112 off42056 00000040:00080000:1.0:1789896033.495058:0:214218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].187, 224 off42280 00000040:00080000:1.0:1789896033.495122:0:214218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].185, 224 off41944 20000000:01000000:1.0:1789896033.495130:0:214218:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:1.0:1789896033.495144:0:214218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].186, 112 off42056 00000040:00080000:1.0:1789896033.495167:0:214218:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].187, 224 off42280 10000000:01000000:1.0:1789896033.495178:0:214218:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789896033.495196:0:214218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.495237:0:214218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5e5 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.495246:0:214218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ec expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.495253:0:214218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.495293:0:214218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ec expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.495306:0:214218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ec expref: 9 pid: 188726 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896033.495321:0:214218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214218:1876838003533440:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789896033.495409:0:214218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5e5 expref: 9 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.495419:0:214218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5e5 expref: 9 pid: 188723 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896033.495428:0:214218:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214218:1876838003533568:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789896033.495451:0:214218:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0000 going to sleep for 11 seconds 00000100:00100000:1.0:1789896033.496413:0:214218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214218:1876838003533440:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789896033.496425:0:214218:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214218:1876838003533568:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789896033.496441:0:214218:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896033.496632:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896033.496664:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896033.496681:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015953536 00000100:00100000:0.0:1789896033.496689:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015953536 00000100:00100000:1.0:1789896033.496701:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015953408 00000100:00100000:1.0:1789896033.496707:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015953408 00010000:00010000:0.0:1789896033.496724:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ec expref: 11 pid: 188726 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.496729:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5e5 expref: 11 pid: 188723 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896033.496768:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 482 00000100:00100000:1.0:1789896033.496778:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 483 00000100:00100000:0.0:1789896033.496784:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015953536:12345-192.168.202.44@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789896033.496792:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015953408:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789896033.496807:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896033.496810:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896033.496818:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ec expref: 11 pid: 188726 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.496823:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5e5 expref: 11 pid: 188723 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.496842:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ec expref: 11 pid: 188726 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.496857:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5e5 expref: 11 pid: 188723 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.496879:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5e5 expref: 11 pid: 188723 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.496880:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5ec expref: 11 pid: 188726 timeout: 4005 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.496901:0:191756:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.496910:0:191756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.496919:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896033.496922:0:191756:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.496942:0:191756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.496949:0:191756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.496958:0:191756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896033.496958:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+9:2403:x1876838015953536:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 178us (325us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896033.496972:0:191756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6400 already unused, calling callback (ffffffffc0c2e250) 00000100:00100000:0.0:1789896033.496973:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 482 00010000:00010000:1.0:1789896033.496979:0:191756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.496990:0:191756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.497013:0:191756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.497022:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896033.497051:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a6f6720b-db77-464e-82b6-5f314c431303+8:2404:x1876838015953408:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 263us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896033.497058:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 483 00010000:00010000:2.0:1789896033.497251:0:214218:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.497262:0:214218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.497268:0:214218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9523c6400/0x412fd4b3617a22b1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896033.516250:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896033.516256:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 159 10000000:01000000:0.0:1789896033.516260:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896033.516309:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.516318:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.516326:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896033.516345:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003533696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.516397:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.516433:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a95215c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.516447:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003533696 00000100:00100000:3.0:1789896033.516454:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003533696 00000100:00100000:3.0:1789896033.516496:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:3.0:1789896033.516504:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003533696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896033.516515:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896033.516526:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a22bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a22b8 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.516545:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a22bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a22b8 expref: 16 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.516552:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a22bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a22b8 expref: 16 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.516568:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2c00, rc 0) 00000100:00100000:3.0:1789896033.516602:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003533696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.516608:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:0.0:1789896033.516638:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003533696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896033.516651:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.516657:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a22bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896033.516710:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003533824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.516734:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.516750:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a95215c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.516756:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003533824 00000100:00100000:3.0:1789896033.516759:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003533824 00000100:00100000:3.0:1789896033.516779:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:3.0:1789896033.516784:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003533824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.516874:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003533824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.516879:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00100000:0.0:1789896033.516895:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003533824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.516918:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003533952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.516949:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.516962:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a95215c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.516970:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003533952 00000100:00100000:3.0:1789896033.516973:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003533952 00000100:00100000:3.0:1789896033.516990:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:3.0:1789896033.516995:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003533952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.517058:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003533952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.517063:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00100000:0.0:1789896033.517077:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003533952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.517298:0:214219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214219:1876838003534080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896033.517322:0:214219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.517339:0:214219:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa4133ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.517353:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003534080 00000100:00100000:3.0:1789896033.517356:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003534080 00000100:00100000:3.0:1789896033.517373:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:3.0:1789896033.517378:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214219:x1876838003534080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.517443:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214219:x1876838003534080:12345-0@lo:502:llog_process_th.0 Request processed in 64us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.517449:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:0.0:1789896033.517449:0:214219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214219:1876838003534080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896033.517491:0:214219:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214219:1876838003534208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896033.517524:0:214219:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896033.517543:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003534208 00000100:00100000:0.0:1789896033.517543:0:214219:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa4133ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.517548:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003534208 00000100:00100000:3.0:1789896033.517564:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:3.0:1789896033.517567:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214219:x1876838003534208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.517611:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214219:x1876838003534208:12345-0@lo:502:llog_process_th.0 Request processed in 43us (88us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.517617:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:0.0:1789896033.517624:0:214219:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214219:1876838003534208:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896033.517644:0:214219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 162 count 159 00000020:01000000:1.0:1789896033.517713:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-161 (rc=0) 10000000:01000000:1.0:1789896033.517734:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896033.517742:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.517753:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896033.517767:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789896033.517769:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 35 10000000:01000000:1.0:1789896033.517771:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789896033.517784:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.517789:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.517794:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896033.517802:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003534336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.517825:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.517839:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0000 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.517856:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003534336 00000100:00100000:3.0:1789896033.517860:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003534336 00000100:00100000:3.0:1789896033.517877:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:3.0:1789896033.517881:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003534336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896033.517887:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896033.517892:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a22cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a22c6 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.517902:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a22cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a22c6 expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.517907:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a22cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a22c6 expref: 17 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.517911:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2400, rc 0) 00000100:00100000:3.0:1789896033.517934:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003534336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 53us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.517937:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1789896033.517970:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003534336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896033.517982:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22cd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.517992:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a22cd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896033.518039:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003534464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.518059:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.518072:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0000 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.518097:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003534464 00000100:00100000:3.0:1789896033.518113:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003534464 00000100:00100000:3.0:1789896033.518137:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:3.0:1789896033.518144:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003534464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.518224:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003534464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.518229:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:1.0:1789896033.518247:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003534464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.518282:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003534592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.518306:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896033.518328:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003534592 00000100:00100000:1.0:1789896033.518330:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0000 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.518332:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003534592 00000100:00100000:3.0:1789896033.518351:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00000100:00100000:3.0:1789896033.518355:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003534592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.518403:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003534592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 48us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.518408:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00100000:1.0:1789896033.518426:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003534592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.518567:0:214220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214220:1876838003534720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896033.518591:0:214220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.518604:0:214220:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.518612:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003534720 00000100:00100000:3.0:1789896033.518615:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003534720 00000100:00100000:3.0:1789896033.518632:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:3.0:1789896033.518636:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:214220:x1876838003534720:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.518684:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:214220:x1876838003534720:12345-0@lo:502:llog_process_th.0 Request processed in 48us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.518688:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00100000:1.0:1789896033.518707:0:214220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214220:1876838003534720:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896033.518727:0:214220:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896033.518735:0:214220:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896033.518738:0:214220:0:(obd_config.c:1561:class_process_config()) marker 171 (0x1) lustre quota.ost 00000020:00000080:1.0:1789896033.518742:0:214220:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789896033.518762:0:214220:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214220:1876838003534848:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896033.518790:0:214220:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.518802:0:214220:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.518810:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003534848 00000100:00100000:3.0:1789896033.518814:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003534848 00000100:00100000:3.0:1789896033.518830:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:3.0:1789896033.518833:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:214220:x1876838003534848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.518876:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:214220:x1876838003534848:12345-0@lo:502:llog_process_th.0 Request processed in 42us (85us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.518882:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:1.0:1789896033.518896:0:214220:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214220:1876838003534848:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896033.518913:0:214220:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896033.518916:0:214220:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896033.518917:0:214220:0:(obd_config.c:1561:class_process_config()) marker 171 (0x2) lustre quota.ost 00000040:00080000:1.0:1789896033.518919:0:214220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 38 count 38 00000020:01000000:0.0:1789896033.518972:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 35-37 (rc=0) 10000000:01000000:0.0:1789896033.518992:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789896033.518998:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22cd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.519007:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22cd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896033.519015:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896033.519017:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 159 10000000:01000000:0.0:1789896033.519018:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896033.519029:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.519033:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.519038:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896033.519046:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003534976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.519066:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.519080:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa4133ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.519089:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003534976 00000100:00100000:3.0:1789896033.519094:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003534976 00000100:00100000:3.0:1789896033.519135:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:3.0:1789896033.519143:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003534976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896033.519149:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896033.519158:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a22d4 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.519172:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a22d4 expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.519180:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a22d4 expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.519186:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3800, rc 0) 00000100:00100000:3.0:1789896033.519234:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003534976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.519239:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:0.0:1789896033.519249:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003534976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896033.519263:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22db expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.519270:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a22db expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896033.519303:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003535104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.519320:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896033.519343:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003535104 00000100:00100000:0.0:1789896033.519345:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa4133ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.519347:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003535104 00000100:00100000:3.0:1789896033.519368:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:3.0:1789896033.519376:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003535104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.519439:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003535104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896033.519443:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003535104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.519453:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:0.0:1789896033.519464:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003535232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.519490:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.519502:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa4133ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.519510:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003535232 00000100:00100000:3.0:1789896033.519513:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003535232 00000100:00100000:3.0:1789896033.519530:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:3.0:1789896033.519535:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003535232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.519582:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003535232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 47us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896033.519589:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003535232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.519593:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:0.0:1789896033.519811:0:214221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214221:1876838003535360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896033.519835:0:214221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.519848:0:214221:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa4133a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.519864:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003535360 00000100:00100000:3.0:1789896033.519867:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003535360 00000100:00100000:3.0:1789896033.519884:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:3.0:1789896033.519888:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214221:x1876838003535360:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.519937:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214221:x1876838003535360:12345-0@lo:502:llog_process_th.0 Request processed in 49us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.519944:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00100000:0.0:1789896033.519944:0:214221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214221:1876838003535360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896033.519982:0:214221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214221:1876838003535488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896033.520014:0:214221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.520030:0:214221:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a95215c780 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.520034:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003535488 00000100:00100000:3.0:1789896033.520037:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003535488 00000100:00100000:3.0:1789896033.520054:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:3.0:1789896033.520058:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214221:x1876838003535488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.520118:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214221:x1876838003535488:12345-0@lo:502:llog_process_th.0 Request processed in 45us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896033.520122:0:214221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214221:1876838003535488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.520124:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000040:00080000:0.0:1789896033.520147:0:214221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 162 count 159 00000020:01000000:1.0:1789896033.520187:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-161 (rc=0) 10000000:01000000:1.0:1789896033.520223:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896033.520228:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22db expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.520235:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22db expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896033.520245:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789896033.520247:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 38 10000000:01000000:1.0:1789896033.520249:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789896033.520261:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.520266:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.520270:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896033.520278:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003535616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.520296:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.520313:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.520347:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003535616 00000100:00100000:3.0:1789896033.520352:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003535616 00000100:00100000:3.0:1789896033.520380:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:3.0:1789896033.520389:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003535616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896033.520396:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896033.520404:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a22e2 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.520418:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a22e2 expref: 19 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.520426:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a22e2 expref: 19 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.520438:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3a00, rc 0) 00000100:00100000:3.0:1789896033.520471:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003535616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.520479:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:1.0:1789896033.520486:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003535616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896033.520499:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22e9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.520507:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a22e9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896033.520543:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003535744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.520569:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.520586:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.520596:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003535744 00000100:00100000:3.0:1789896033.520601:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003535744 00000100:00100000:3.0:1789896033.520623:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:3.0:1789896033.520629:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003535744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.520689:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003535744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.520696:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00100000:1.0:1789896033.520715:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003535744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.520744:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003535872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.520767:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.520779:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0240 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.520790:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003535872 00000100:00100000:3.0:1789896033.520795:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003535872 00000100:00100000:3.0:1789896033.520817:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:3.0:1789896033.520823:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003535872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.520883:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003535872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.520890:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00100000:1.0:1789896033.520903:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003535872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.521081:0:214222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214222:1876838003536000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896033.521117:0:214222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.521129:0:214222:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.521143:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003536000 00000100:00100000:3.0:1789896033.521148:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003536000 00000100:00100000:3.0:1789896033.521171:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:3.0:1789896033.521178:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:214222:x1876838003536000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.521268:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:214222:x1876838003536000:12345-0@lo:502:llog_process_th.0 Request processed in 90us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896033.521275:0:214222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214222:1876838003536000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.521278:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000020:01000000:1.0:1789896033.521294:0:214222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896033.521299:0:214222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896033.521300:0:214222:0:(obd_config.c:1561:class_process_config()) marker 172 (0x1) lustre quota.ost 00000020:00000080:1.0:1789896033.521303:0:214222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789896033.521317:0:214222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214222:1876838003536128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896033.521340:0:214222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.521358:0:214222:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa50343540 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.521366:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003536128 00000100:00100000:3.0:1789896033.521371:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003536128 00000100:00100000:3.0:1789896033.521396:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:3.0:1789896033.521403:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:214222:x1876838003536128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.521470:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:214222:x1876838003536128:12345-0@lo:502:llog_process_th.0 Request processed in 66us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.521477:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:1.0:1789896033.521487:0:214222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214222:1876838003536128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896033.521505:0:214222:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896033.521508:0:214222:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896033.521509:0:214222:0:(obd_config.c:1561:class_process_config()) marker 172 (0x2) lustre quota.ost 00000040:00080000:1.0:1789896033.521511:0:214222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 41 count 41 00000020:01000000:0.0:1789896033.521545:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 38-40 (rc=0) 10000000:01000000:0.0:1789896033.521566:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789896033.521571:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22e9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.521584:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22e9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896033.521589:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896033.521590:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 159 10000000:01000000:0.0:1789896033.521591:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896033.521601:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.521606:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.521610:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896033.521618:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003536256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.521635:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.521648:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa4133a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.521661:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003536256 00000100:00100000:3.0:1789896033.521666:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003536256 00000100:00100000:3.0:1789896033.521688:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:3.0:1789896033.521695:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003536256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896033.521701:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896033.521708:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3200/0x412fd4b3617a22f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a22f0 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.521721:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3200/0x412fd4b3617a22f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a22f0 expref: 20 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.521728:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3200/0x412fd4b3617a22f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a22f0 expref: 20 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.521734:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3200, rc 0) 00000100:00100000:3.0:1789896033.521763:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003536256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.521769:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:0.0:1789896033.521775:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003536256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896033.521787:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22f7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.521793:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a22f7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896033.521819:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003536384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.521836:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.521853:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa4133a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.521863:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003536384 00000100:00100000:3.0:1789896033.521867:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003536384 00000100:00100000:3.0:1789896033.521888:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:3.0:1789896033.521896:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003536384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.521962:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003536384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896033.521966:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003536384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.521974:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00100000:0.0:1789896033.521988:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003536512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.522014:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.522026:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa4133a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.522039:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003536512 00000100:00100000:3.0:1789896033.522043:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003536512 00000100:00100000:3.0:1789896033.522065:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:3.0:1789896033.522073:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003536512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.522143:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003536512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896033.522149:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003536512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.522151:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00100000:0.0:1789896033.522324:0:214223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214223:1876838003536640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896033.522347:0:214223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.522365:0:214223:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa4133a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.522374:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003536640 00000100:00100000:3.0:1789896033.522379:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003536640 00000100:00100000:3.0:1789896033.522402:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:3.0:1789896033.522410:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214223:x1876838003536640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.522478:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214223:x1876838003536640:12345-0@lo:502:llog_process_th.0 Request processed in 69us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896033.522481:0:214223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214223:1876838003536640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.522491:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00100000:0.0:1789896033.522513:0:214223:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214223:1876838003536768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896033.522538:0:214223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.522550:0:214223:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a95215cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.522561:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003536768 00000100:00100000:3.0:1789896033.522565:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003536768 00000100:00100000:3.0:1789896033.522588:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:3.0:1789896033.522595:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214223:x1876838003536768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.522658:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214223:x1876838003536768:12345-0@lo:502:llog_process_th.0 Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896033.522660:0:214223:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214223:1876838003536768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.522671:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000040:00080000:0.0:1789896033.522682:0:214223:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 162 count 159 00000020:01000000:1.0:1789896033.522729:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-161 (rc=0) 10000000:01000000:1.0:1789896033.522747:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896033.522752:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22f7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.522761:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a22f7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896033.522773:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789896033.522774:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 182 10000000:01000000:1.0:1789896033.522775:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789896033.522786:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.522790:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.522795:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896033.522802:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003536896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.522826:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.522843:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.522853:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003536896 00000100:00100000:3.0:1789896033.522857:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003536896 00000100:00100000:3.0:1789896033.522883:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:3.0:1789896033.522889:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003536896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896033.522895:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896033.522902:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a22fe expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.522915:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a22fe expref: 21 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.522922:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a22fe expref: 21 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.522928:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2800, rc 0) 00000100:00100000:3.0:1789896033.522957:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003536896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.522963:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:1.0:1789896033.522979:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003536896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896033.522992:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2305 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.523000:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2305 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896033.523035:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003537024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.523052:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.523063:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.523075:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003537024 00000100:00100000:3.0:1789896033.523080:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003537024 00000100:00100000:3.0:1789896033.523121:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050 00000100:00100000:3.0:1789896033.523130:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003537024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.523187:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003537024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 59us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.523193:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050 00000100:00100000:1.0:1789896033.523235:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003537024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.523262:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003537152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.523284:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.523302:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.523311:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003537152 00000100:00100000:3.0:1789896033.523316:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003537152 00000100:00100000:3.0:1789896033.523339:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051 00000100:00100000:3.0:1789896033.523347:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003537152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.523407:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003537152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.523420:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051 00000100:00100000:1.0:1789896033.523423:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003537152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.523579:0:214224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214224:1876838003537280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896033.523613:0:214224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.523630:0:214224:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa42a78300 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.523640:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003537280 00000100:00100000:3.0:1789896033.523645:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003537280 00000100:00100000:3.0:1789896033.523667:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:3.0:1789896033.523674:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214224:x1876838003537280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.523746:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214224:x1876838003537280:12345-0@lo:502:llog_process_th.0 Request processed in 72us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.523754:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:1.0:1789896033.523759:0:214224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214224:1876838003537280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896033.523780:0:214224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896033.523786:0:214224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896033.523788:0:214224:0:(obd_config.c:1561:class_process_config()) marker 169 (0x1) lustre quota.ost 00000020:00000080:1.0:1789896033.523792:0:214224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789896033.523797:0:214224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896033.523799:0:214224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896033.523801:0:214224:0:(obd_config.c:1561:class_process_config()) marker 169 (0x2) lustre quota.ost 00000020:01000000:1.0:1789896033.523804:0:214224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896033.523808:0:214224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896033.523809:0:214224:0:(obd_config.c:1561:class_process_config()) marker 175 (0x1) lustre-MDT0001-m new lustre.qpool1 00000020:00000080:1.0:1789896033.523812:0:214224:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1789896033.523862:0:214224:0:(lod_pool.c:475:lod_pool_new()) qpool1 is pool #1 00000100:00100000:1.0:1789896033.523876:0:214224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214224:1876838003537408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896033.523899:0:214224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.523911:0:214224:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa778d0180 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.523926:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003537408 00000100:00100000:3.0:1789896033.523931:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003537408 00000100:00100000:3.0:1789896033.523953:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:3.0:1789896033.523958:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214224:x1876838003537408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.524015:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214224:x1876838003537408:12345-0@lo:502:llog_process_th.0 Request processed in 57us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.524023:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00100000:1.0:1789896033.524030:0:214224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214224:1876838003537408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896033.524047:0:214224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896033.524050:0:214224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896033.524051:0:214224:0:(obd_config.c:1561:class_process_config()) marker 175 (0x2) lustre-MDT0001-m new lustre.qpool1 00000040:00080000:1.0:1789896033.524057:0:214224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 188 count 184 00000020:01000000:0.0:1789896033.524093:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 182-187 (rc=0) 10000000:01000000:0.0:1789896033.524124:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789896033.524128:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2305 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.524134:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2305 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896033.524138:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896033.524139:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 159 10000000:01000000:0.0:1789896033.524145:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896033.524155:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.524160:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.524164:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896033.524172:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003537536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.524190:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896033.524222:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003537536 00000100:00100000:3.0:1789896033.524227:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003537536 00000100:00100000:0.0:1789896033.524237:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a95215cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.524256:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:3.0:1789896033.524264:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003537536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896033.524270:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896033.524277:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2313 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a230c expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.524290:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a230c expref: 22 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.524298:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a230c expref: 22 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.524309:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d3e00, rc 0) 00000100:00100000:3.0:1789896033.524339:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003537536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.524346:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00100000:0.0:1789896033.524351:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003537536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896033.524361:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2313 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896033.524366:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2313 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896033.524390:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003537664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.524406:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.524417:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a95215cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.524429:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003537664 00000100:00100000:3.0:1789896033.524434:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003537664 00000100:00100000:3.0:1789896033.524458:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:3.0:1789896033.524463:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003537664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.524522:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003537664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896033.524529:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003537664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.524531:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00100000:0.0:1789896033.524553:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003537792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.524578:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.524589:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a95215cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.524600:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003537792 00000100:00100000:3.0:1789896033.524605:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003537792 00000100:00100000:3.0:1789896033.524627:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:3.0:1789896033.524633:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003537792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.524692:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003537792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.524699:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00100000:0.0:1789896033.524708:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003537792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896033.524914:0:214225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214225:1876838003537920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896033.524938:0:214225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.524955:0:214225:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a95215c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.524983:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003537920 00000100:00100000:3.0:1789896033.524987:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003537920 00000100:00100000:3.0:1789896033.525010:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:3.0:1789896033.525016:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214225:x1876838003537920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.525079:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214225:x1876838003537920:12345-0@lo:502:llog_process_th.0 Request processed in 62us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.525086:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:0.0:1789896033.525097:0:214225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214225:1876838003537920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896033.525141:0:214225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214225:1876838003538048:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896033.525171:0:214225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896033.525190:0:214225:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a95215c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.525196:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003538048 00000100:00100000:3.0:1789896033.525222:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003538048 00000100:00100000:3.0:1789896033.525246:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:3.0:1789896033.525254:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214225:x1876838003538048:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.525310:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214225:x1876838003538048:12345-0@lo:502:llog_process_th.0 Request processed in 58us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.525317:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00100000:0.0:1789896033.525322:0:214225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214225:1876838003538048:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896033.525340:0:214225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 162 count 159 00000020:01000000:1.0:1789896033.525377:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 159-161 (rc=0) 10000000:01000000:1.0:1789896033.525400:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789896033.525406:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2313 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.525415:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2313 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896033.525423:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789896033.525425:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 182 10000000:01000000:1.0:1789896033.525427:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789896033.525442:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.525449:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.525457:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896033.525470:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003538176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.525496:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.525523:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa42a78300 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.525535:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003538176 00000100:00100000:3.0:1789896033.525540:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003538176 00000100:00100000:3.0:1789896033.525560:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:3.0:1789896033.525566:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003538176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896033.525573:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896033.525581:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2321 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a231a expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.525593:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a231a expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.525600:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a231a expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.525607:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2600, rc 0) 00000100:00100000:3.0:1789896033.525633:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003538176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.525640:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:1.0:1789896033.525648:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003538176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789896033.525662:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2321 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896033.525671:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2321 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896033.525714:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003538304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.525746:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.525764:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa42a78300 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.525772:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003538304 00000100:00100000:3.0:1789896033.525777:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003538304 00000100:00100000:3.0:1789896033.525798:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:3.0:1789896033.525804:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003538304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.525865:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003538304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.525872:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00100000:1.0:1789896033.525879:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003538304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.525906:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003538432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.525940:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.525956:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa42a78300 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.525966:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003538432 00000100:00100000:3.0:1789896033.525970:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003538432 00000100:00100000:3.0:1789896033.525992:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:3.0:1789896033.525998:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003538432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.526061:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003538432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 62us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.526068:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00100000:1.0:1789896033.526071:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003538432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896033.526325:0:214226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214226:1876838003538560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896033.526361:0:214226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.526386:0:214226:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa42a78cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.526391:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003538560 00000100:00100000:3.0:1789896033.526396:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003538560 00000100:00100000:3.0:1789896033.526419:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:3.0:1789896033.526425:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214226:x1876838003538560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.526498:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214226:x1876838003538560:12345-0@lo:502:llog_process_th.0 Request processed in 72us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.526505:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:1.0:1789896033.526510:0:214226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214226:1876838003538560:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896033.526534:0:214226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896033.526539:0:214226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896033.526541:0:214226:0:(obd_config.c:1561:class_process_config()) marker 170 (0x1) lustre quota.ost 00000020:00000080:1.0:1789896033.526545:0:214226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789896033.526550:0:214226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896033.526552:0:214226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896033.526554:0:214226:0:(obd_config.c:1561:class_process_config()) marker 170 (0x2) lustre quota.ost 00000020:01000000:1.0:1789896033.526556:0:214226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789896033.526559:0:214226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896033.526561:0:214226:0:(obd_config.c:1561:class_process_config()) marker 174 (0x1) lustre-MDT0000-m new lustre.qpool1 00000020:00000080:1.0:1789896033.526564:0:214226:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1789896033.526593:0:214226:0:(lod_pool.c:475:lod_pool_new()) qpool1 is pool #1 00080000:10000000:1.0:1789896033.527156:0:214226:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x54:0x0] (8/32) registered 00080000:10000000:1.0:1789896033.528330:0:214226:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x55:0x0] (8/32) registered 00080000:10000000:1.0:1789896033.529088:0:214226:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x56:0x0] (8/32) registered 00000100:00100000:1.0:1789896033.529820:0:214226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214226:1876838003538688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896033.529855:0:214226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896033.529879:0:214226:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa50343540 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.529893:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003538688 00000100:00100000:3.0:1789896033.529899:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003538688 00000100:00100000:3.0:1789896033.529923:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:3.0:1789896033.529930:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214226:x1876838003538688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896033.529996:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214226:x1876838003538688:12345-0@lo:502:llog_process_th.0 Request processed in 66us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.530005:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00100000:1.0:1789896033.530019:0:214226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214226:1876838003538688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789896033.530041:0:214226:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789896033.530046:0:214226:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789896033.530047:0:214226:0:(obd_config.c:1561:class_process_config()) marker 174 (0x2) lustre-MDT0000-m new lustre.qpool1 00000040:00080000:1.0:1789896033.530051:0:214226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 188 count 184 00000020:01000000:2.0:1789896033.530124:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 182-187 (rc=0) 10000000:01000000:2.0:1789896033.530139:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789896033.530145:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2321 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.530152:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2321 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896033.530158:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789896033.530159:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:2.0:1789896033.530160:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789896033.530173:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.530177:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.530182:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896033.530191:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e18a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003538816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896033.530241:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896033.530260:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.530270:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003538816 00000100:00100000:3.0:1789896033.530275:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003538816 00000100:00100000:3.0:1789896033.530304:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:3.0:1789896033.530311:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003538816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896033.530317:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789896033.530325:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a232f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2328 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.530339:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a232f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2328 expref: 24 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.530348:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a232f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2328 expref: 24 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896033.530355:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a9512d2200, rc 0) 00000100:00100000:3.0:1789896033.530385:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003538816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896033.530392:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00100000:2.0:1789896033.530412:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e18a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003538816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896033.530422:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a232f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.530428:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a232f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896033.530460:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e18a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003538944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896033.530477:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896033.530488:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789896033.530504:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003538944 00000100:00100000:3.0:1789896033.530509:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003538944 00000100:00100000:3.0:1789896033.530531:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:3.0:1789896033.530538:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003538944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896033.530585:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003538944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 47us (105us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789896033.530593:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:2.0:1789896033.530609:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e18a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003538944:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789896033.530628:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789896033.530631:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a232f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896033.530636:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a232f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896034.163627:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896034.163662:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896034.163685:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015953664 00000100:00100000:2.0:1789896034.163696:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896034.163698:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015953664 00000100:00100000:0.0:1789896034.163723:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015953792 00000100:00100000:0.0:1789896034.163729:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015953792 00000100:00100000:1.0:1789896034.163754:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015953920 00000100:00100000:1.0:1789896034.163761:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015953920 00000100:00100000:3.0:1789896034.163762:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2066 00000100:00100000:0.0:1789896034.163771:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 497 00000100:00100000:3.0:1789896034.163777:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+8:2401:x1876838015953664:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789896034.163783:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2402:x1876838015953792:12345-192.168.202.44@tcp:400:kworker.0 00000100:00080000:2.0:1789896034.163800:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789896034.163817:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 498 00000100:00100000:1.0:1789896034.163827:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2401:x1876838015953920:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:0.0:1789896034.163849:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2402:x1876838015953792:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 70us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896034.163856:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+8:2401:x1876838015953664:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 82us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896034.163859:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 497 00000100:00100000:1.0:1789896034.163862:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2401:x1876838015953920:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 36us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896034.163877:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2066 00000100:00100000:1.0:1789896034.163877:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 498 00010000:00010000:0.0:1789896034.284378:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896034.732415:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789896034.732425:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789896034.732439:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003539200:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789896034.732453:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003539712:0@lo:400:kworker.0 00000100:00100000:1.0:1789896034.732499:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003539328:0@lo:400:kworker.0 00000100:00100000:1.0:1789896034.732531:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896034.732537:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896034.732567:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003539584:0@lo:400:kworker.0 00000100:00100000:1.0:1789896034.732567:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003539840:0@lo:400:kworker.0 00000100:00100000:1.0:1789896034.732594:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896034.732601:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896034.732608:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003539456:0@lo:400:kworker.0 00000100:00100000:1.0:1789896034.732615:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876838003540352:0@lo:400:kworker.0 00000100:00100000:3.0:1789896034.732619:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876838003540224:0@lo:400:kworker.0 00000100:00100000:3.0:1789896034.732655:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896034.732663:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896034.732666:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003539328 00000100:00100000:1.0:1789896034.732674:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003539328 00000100:00100000:3.0:1789896034.732678:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876838003540736:0@lo:400:kworker.0 00000100:00100000:2.0:1789896034.732694:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003539968:0@lo:400:kworker.0 00000100:00100000:3.0:1789896034.732704:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896034.732716:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003539840 00000100:00100000:1.0:1789896034.732719:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003539840 00000100:00100000:3.0:1789896034.732725:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789896034.732731:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896034.732733:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003540096:0@lo:400:kworker.0 00000100:00100000:1.0:1789896034.732738:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789896034.732754:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa72d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003539328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896034.732759:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876838003540480:0@lo:400:kworker.0 00000100:00100000:3.0:1789896034.732765:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896034.732791:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876838003540608:0@lo:400:kworker.0 00000100:00100000:2.0:1789896034.732798:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896034.732811:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa72d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003539328:12345-0@lo:400:kworker.0 Request processed in 58us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896034.732819:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789896034.732826:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003540992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789896034.732830:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896034.732837:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789896034.732844:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa72d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003539840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896034.732864:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896034.732871:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003539712 00000100:00100000:3.0:1789896034.732876:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003539712 00000100:00100000:1.0:1789896034.732878:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa72d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003539840:12345-0@lo:400:kworker.0 Request processed in 35us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896034.732885:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789896034.732895:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789896034.732905:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003540864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789896034.732908:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003540224 00000100:00100000:3.0:1789896034.732913:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003540224 00000100:00100000:1.0:1789896034.732920:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003540736 00000100:00100000:1.0:1789896034.732923:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003540736 00000100:00100000:3.0:1789896034.732929:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003540480 00000100:00100000:3.0:1789896034.732931:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003540480 00000100:00100000:2.0:1789896034.732936:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896034.732946:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003540608 00000100:00100000:1.0:1789896034.732949:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003540608 00000100:00100000:3.0:1789896034.732951:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1789896034.732958:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876838003539712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896034.732968:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1789896034.732975:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876838003540224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896034.732978:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003539584 00000100:00100000:2.0:1789896034.732984:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003539584 00000100:00100000:3.0:1789896034.733000:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876838003539712:12345-0@lo:400:kworker.0 Request processed in 42us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896034.733001:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876838003540224:12345-0@lo:400:kworker.0 Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896034.733008:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1789896034.733020:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1789896034.733023:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1789896034.733029:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876838003540736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896034.733045:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1789896034.733047:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896034.733054:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876838003540480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896034.733060:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876838003540736:12345-0@lo:400:kworker.0 Request processed in 32us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896034.733065:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:0.0:1789896034.733078:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003539072:0@lo:400:kworker.0 00000100:00100000:1.0:1789896034.733079:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:1.0:1789896034.733104:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876838003540608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896034.733130:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876838003540480:12345-0@lo:400:kworker.0 Request processed in 77us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896034.733136:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896034.733141:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876838003540608:12345-0@lo:400:kworker.0 Request processed in 52us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896034.733142:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1789896034.733154:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1789896034.733165:0:190235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003539456 00000100:00100000:3.0:1789896034.733169:0:190235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003539456 00000100:00100000:3.0:1789896034.733189:0:190235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003539968 00000100:00100000:3.0:1789896034.733192:0:190235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003539968 00000100:00100000:1.0:1789896034.733193:0:190237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003540992 00000100:00100000:1.0:1789896034.733196:0:190237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003540992 00000100:00100000:0.0:1789896034.733219:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003540864 00000100:00100000:3.0:1789896034.733228:0:190235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003540096 00000100:00100000:0.0:1789896034.733231:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003540864 00000100:00100000:3.0:1789896034.733233:0:190235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003540096 00000100:00100000:1.0:1789896034.733241:0:190237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003539200 00000100:00100000:1.0:1789896034.733244:0:190237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003539200 00000100:00100000:3.0:1789896034.733259:0:190235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789896034.733264:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789896034.733265:0:190235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1876838003539584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896034.733272:0:196139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789896034.733273:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876838003540992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789896034.733287:0:196139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876838003540864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789896034.733297:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789896034.733299:0:190235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1876838003539584:12345-0@lo:400:kworker.0 Request processed in 33us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896034.733304:0:190235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00002000:00000024:0.0:1789896034.733308:0:196139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789896034.733319:0:190235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789896034.733325:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003540992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896034.733327:0:190235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1876838003539456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896034.733332:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789896034.733345:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789896034.733351:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1876838003539200:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789896034.733356:0:196139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1876838003540864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (419us total) trans 0 rc 0/0 00002000:00000024:1.0:1789896034.733362:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789896034.733366:0:190235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1876838003539456:12345-0@lo:400:kworker.0 Request processed in 39us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896034.733368:0:196139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789896034.733378:0:190235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789896034.733391:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3617:x1876838003539200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896034.733396:0:190235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789896034.733397:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789896034.733400:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003539072 00000100:00100000:3.0:1789896034.733404:0:190235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa58e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003539968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896034.733406:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003539072 00000100:00100000:1.0:1789896034.733419:0:191520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789896034.733428:0:191520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003540096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896034.733437:0:190235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa58e1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003539968:12345-0@lo:400:kworker.0 Request processed in 37us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896034.733448:0:190235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789896034.733448:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:1.0:1789896034.733452:0:191520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003540096:12345-0@lo:400:kworker.0 Request processed in 27us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896034.733458:0:191520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789896034.733463:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3617:x1876838003539072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896034.733495:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896034.733505:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3617:x1876838003539072:12345-0@lo:400:kworker.0 Request processed in 46us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896034.733507:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3617:1876838003539200:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789896034.733518:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00100000:3.0:1789896034.733525:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003539328:0@lo:400:kworker.0 00000100:00100000:1.0:1789896034.733525:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003539072:0@lo:400:kworker.0 00000100:00100000:3.0:1789896034.733547:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003539840:0@lo:400:kworker.0 00000100:00100000:3.0:1789896034.733567:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003540352 00000100:00100000:3.0:1789896034.733570:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003540352 00000100:00080000:0.0:1789896034.733580:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789896034.733581:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003540864:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789896034.733587:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789896034.733592:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789896034.733597:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789896034.733601:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1789896034.733603:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94691ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003539456:0@lo:400:kworker.0 00000100:00100000:3.0:1789896034.733607:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3615:x1876838003540352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896034.733613:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003539968:0@lo:400:kworker.0 00000100:00100000:0.0:1789896034.733634:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003540096:0@lo:400:kworker.0 00010000:00080000:1.0:1789896034.733636:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a95085aa00 x1876838003540480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789896034.733646:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3615:x1876838003540352:12345-0@lo:400:kworker.0 Request processed in 40us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896034.733650:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3616:1876838003540480:0@lo:400:kworker.0 00000100:00100000:3.0:1789896034.733653:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:0.0:1789896034.733657:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876838003540608:0@lo:400:kworker.0 00000100:00100000:1.0:1789896034.733670:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa58e18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003540992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789896034.733680:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876838003540224:0@lo:400:kworker.0 00000100:00100000:3.0:1789896034.733683:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3615:1876838003540352:0@lo:400:kworker.0 00010000:00080000:0.0:1789896034.733702:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91aa72d4df80 x1876838003540736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789896034.733712:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3618:1876838003540736:0@lo:400:kworker.0 00000100:00100000:0.0:1789896034.733722:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003539712:0@lo:400:kworker.0 00000100:00100000:0.0:1789896034.733739:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003539584:0@lo:400:kworker.0 00010000:00010000:2.0:1789896035.308424:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896035.315680:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896035.315741:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015954048 00000100:00100000:2.0:1789896035.315750:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015954048 00000100:00100000:2.0:1789896035.315796:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2068 00000100:00100000:2.0:1789896035.315804:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015954048:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896035.315817:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896035.315832:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f5f3 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896035.315855:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5f3 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896035.315864:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5f3 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896035.315894:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9600, rc 0) 00000100:00100000:2.0:1789896035.315942:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015954048:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 140us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896035.315947:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2068 00000100:00100000:3.0:1789896035.316658:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896035.316712:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015954176 00000100:00100000:0.0:1789896035.316717:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015954176 00000100:00100000:0.0:1789896035.316747:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2069 00000100:00100000:0.0:1789896035.316754:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015954176:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896035.316883:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015954176:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 126us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896035.316892:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2069 00000100:00100000:0.0:1789896035.317466:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896035.317501:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015954304 00000100:00100000:2.0:1789896035.317505:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015954304 00000100:00100000:2.0:1789896035.317527:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2070 00000100:00100000:2.0:1789896035.317534:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015954304:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896035.317611:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015954304:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 76us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896035.317618:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2070 00000100:00100000:2.0:1789896035.318519:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896035.318569:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015954432 00000100:00100000:0.0:1789896035.318574:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015954432 00000100:00100000:0.0:1789896035.318599:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2071 00000100:00100000:0.0:1789896035.318606:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:213688:x1876838015954432:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789896035.318696:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:213688:x1876838015954432:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 89us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896035.318703:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2071 00000100:00100000:3.0:1789896035.319332:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896035.319371:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015954560 00000100:00100000:2.0:1789896035.319376:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015954560 00000100:00100000:2.0:1789896035.319398:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2072 00000100:00100000:2.0:1789896035.319404:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:213688:x1876838015954560:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896035.319455:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:213688:x1876838015954560:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 51us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896035.319460:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2072 00000100:00100000:2.0:1789896035.320297:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896035.320337:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015954688 00000100:00100000:0.0:1789896035.320341:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015954688 00000100:00100000:0.0:1789896035.320365:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2073 00000100:00100000:0.0:1789896035.320373:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015954688:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896035.320382:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896035.320394:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a233d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f5fa expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896035.320424:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a233d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5fa expref: 10 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896035.320434:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a233d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5fa expref: 10 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896035.320442:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a400, rc 0) 00000100:00100000:0.0:1789896035.320469:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015954688:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 97us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896035.320476:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2073 00000100:00100000:0.0:1789896035.321040:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896035.321082:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015954816 00000100:00100000:2.0:1789896035.321098:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015954816 00000100:00100000:2.0:1789896035.321128:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2074 00000100:00100000:2.0:1789896035.321135:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015954816:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896035.321232:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015954816:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 96us (190us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789896035.321240:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2074 00000100:00100000:1.0:1789896035.756390:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003541120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789896035.756455:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896035.756524:0:188736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003541120 00000100:00100000:2.0:1789896035.756534:0:188736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003541120 00000100:00100000:2.0:1789896035.756587:0:188736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789896035.756598:0:188736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa72d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003541120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789896035.756633:0:188736:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789896035.756686:0:188736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa72d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003541120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896035.756695:0:188736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789896035.756726:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003541120:0@lo:41:osp-pre-1-0.0 00000020:00000080:3.0:1789896036.171101:0:214323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd17e7ded0 20000000:00000080:3.0:1789896036.171118:0:214323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91a94db39400 uarg=0000000000000000 00000040:00100000:3.0:1789896036.171601:0:214323:0:(llog.c:1072:llog_reverse_process()) index 161 : idx 137 20000000:01000000:3.0:1789896036.171606:0:214323:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 160 cmd:0xce020 lustre.qpool1 00000040:00080000:3.0:1789896036.171672:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].162, 224 off37728 20000000:01000000:3.0:1789896036.171693:0:214323:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:3.0:1789896036.171710:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].163, 128 off37856 00000040:00080000:3.0:1789896036.171726:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].164, 224 off38080 00000040:00080000:3.0:1789896036.171777:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].188, 224 off42504 20000000:01000000:3.0:1789896036.171785:0:214323:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:3.0:1789896036.171797:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].189, 136 off42640 00000040:00080000:3.0:1789896036.171810:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].190, 224 off42864 00000040:00080000:3.0:1789896036.171858:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].188, 224 off42504 20000000:01000000:3.0:1789896036.171866:0:214323:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:3.0:1789896036.171880:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].189, 136 off42640 00000040:00080000:3.0:1789896036.171895:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].190, 224 off42864 10000000:01000000:3.0:1789896036.171905:0:214323:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789896036.171928:0:214323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.171945:0:214323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a22bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a22b8 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.171952:0:214323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a22cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a22c6 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.171958:0:214323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a22d4 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.171963:0:214323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a22e2 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.171970:0:214323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d3200/0x412fd4b3617a22f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a22f0 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.171975:0:214323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a22fe expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.171981:0:214323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a230c expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.171986:0:214323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a231a expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.171991:0:214323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a232f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2328 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.172000:0:214323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2336 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5f3 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.172013:0:214323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a233d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5fa expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.172020:0:214323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.172058:0:214323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a233d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5fa expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.172073:0:214323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a233d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5fa expref: 9 pid: 188725 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.172100:0:214323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003541248:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789896036.172214:0:214323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5f3 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.172224:0:214323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2336 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5f3 expref: 9 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.172234:0:214323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003541376:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789896036.172278:0:214323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a232f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2328 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.172287:0:214323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a232f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2328 expref: 23 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.172296:0:214323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003541504:0@lo:104: 00000100:00100000:3.0:1789896036.172333:0:214323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896036.172419:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003541504 00000100:00100000:2.0:1789896036.172426:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003541504 00010000:00010000:3.0:1789896036.172440:0:214323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2321 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a231a expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.172449:0:214323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a231a expref: 23 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.172456:0:214323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003541632:0@lo:104: 00000100:00100000:2.0:1789896036.172474:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:2.0:1789896036.172482:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:214323:x1876838003541504:12345-0@lo:104: 00010000:00010000:2.0:1789896036.172495:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a232f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.172509:0:214323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896036.172534:0:214323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a230c expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.172541:0:214323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2313 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a230c expref: 23 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.172543:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003541632 00000100:00100000:3.0:1789896036.172552:0:214323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa65fe2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003541760:0@lo:104: 00010000:00010000:2.0:1789896036.172554:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789896036.172559:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003541632 00000100:00100000:2.0:1789896036.172565:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:214323:x1876838003541504:12345-0@lo:104: Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896036.172574:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00010000:00010000:1.0:1789896036.172583:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789896036.172584:0:214323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896036.172593:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a232f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896036.172596:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003541760 00000100:00100000:2.0:1789896036.172600:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003541760 00010000:00010000:1.0:1789896036.172603:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8600 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:0.0:1789896036.172608:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 10000000:00010000:1.0:1789896036.172609:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a232f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.172620:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a232f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.172622:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa65fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214323:x1876838003541632:12345-0@lo:104: 00000100:00100000:2.0:1789896036.172623:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1789896036.172634:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214323:x1876838003541760:12345-0@lo:104: 10000000:00010000:1.0:1789896036.172635:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a232f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.172638:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2321 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.172642:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2313 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896036.172642:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896036.172677:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a232f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.172690:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789896036.172690:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896036.172696:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214323:x1876838003541760:12345-0@lo:104: Request processed in 64us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896036.172704:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00010000:00010000:3.0:1789896036.172710:0:214323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a22fe expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.172711:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a232f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.172720:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789896036.172731:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789896036.172732:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8600/0x412fd4b3617a2328 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a232f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.172732:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa65fe0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:214323:x1876838003541632:12345-0@lo:104: Request processed in 113us (220us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896036.172733:0:214323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a22fe expref: 23 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.172747:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2313 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.172752:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00010000:00010000:1.0:1789896036.172759:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789896036.172762:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5aa00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896036.172763:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2321 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.172764:0:214323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003541888:0@lo:104: 10000000:00010000:2.0:1789896036.172766:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2313 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.172774:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7600 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896036.172777:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2313 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896036.172778:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2321 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789896036.172784:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2313 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.172785:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2321 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.172789:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003542016:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1789896036.172792:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1789896036.172795:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2321 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.172806:0:214323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1789896036.172809:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896036.172823:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2313 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.172824:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2321 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.172830:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896036.172830:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896036.172837:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896036.172841:0:214323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d3200/0x412fd4b3617a22f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a22f0 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.172847:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2313 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.172847:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2321 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.172851:0:214323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d3200/0x412fd4b3617a22f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a22f0 expref: 23 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.172867:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a230c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2313 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.172867:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7600/0x412fd4b3617a231a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2321 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.172869:0:214323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003542400:0@lo:104: 00010000:00010000:0.0:1789896036.172873:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896036.172886:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003542016 00010000:00010000:2.0:1789896036.172891:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896036.172891:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896036.172894:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896036.172894:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896036.172899:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896036.172899:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896036.172900:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003542016 00000100:00100000:3.0:1789896036.172905:0:214323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896036.172914:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003542144:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896036.172915:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003542272:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896036.172927:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a232f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2328 expref: 24 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.172933:0:214323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a22e2 expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.172945:0:214323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a22e2 expref: 24 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.172958:0:214323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003542528:0@lo:104: 00000100:00100000:1.0:1789896036.172964:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896036.172964:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1789896036.172987:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003542272 00000100:00100000:0.0:1789896036.172988:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3618:x1876838003542016:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896036.172994:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003542272 00000100:00100000:3.0:1789896036.172995:0:214323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896036.173007:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896036.173018:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2321 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a231a expref: 25 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.173018:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a232f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2328 expref: 25 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.173027:0:214323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a22d4 expref: 25 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173034:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003541888 00000100:00100000:1.0:1789896036.173040:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003541888 00010000:00010000:3.0:1789896036.173049:0:214323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a22d4 expref: 25 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173060:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003542400 00000100:00100000:3.0:1789896036.173061:0:214323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003542656:0@lo:104: 00010000:00010000:0.0:1789896036.173061:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a232f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2328 expref: 25 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896036.173064:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1789896036.173065:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003542400 00000100:00100000:2.0:1789896036.173088:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa72d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3615:x1876838003542272:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896036.173094:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003542528 00010000:00010000:0.0:1789896036.173095:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896036.173098:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896036.173098:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003542528 00010000:00010000:2.0:1789896036.173104:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2321 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a231a expref: 25 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.173115:0:214323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896036.173118:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2321 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a231a expref: 25 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173118:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1789896036.173127:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a9478b1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214323:x1876838003541888:12345-0@lo:104: 00010000:00010000:2.0:1789896036.173131:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896036.173135:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2305 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.173144:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3618:x1876838003542016:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (306us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896036.173147:0:214323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a22cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a22c6 expref: 25 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.173163:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:2.0:1789896036.173167:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa72d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3615:x1876838003542272:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (210us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896036.173170:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789896036.173175:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a9478b1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214323:x1876838003541888:12345-0@lo:104: Request processed in 51us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896036.173176:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1789896036.173181:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00010000:00010000:0.0:1789896036.173185:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896036.173192:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2305 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.173225:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7c00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896036.173229:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2305 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173234:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003542656 00000100:00100000:2.0:1789896036.173235:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896036.173239:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003542656 00010000:00010000:0.0:1789896036.173249:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2305 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.173254:0:214323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a22cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a22c6 expref: 23 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173260:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 10000000:00010000:0.0:1789896036.173267:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2305 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896036.173272:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003542144 00000100:00100000:1.0:1789896036.173272:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214323:x1876838003542400:12345-0@lo:104: 00000100:00100000:3.0:1789896036.173274:0:214323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003542784:0@lo:104: 00000100:00100000:2.0:1789896036.173278:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003542144 00010000:00010000:1.0:1789896036.173288:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a22f7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896036.173295:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896036.173297:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2313 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a230c expref: 24 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.173311:0:214323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896036.173317:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2305 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.173325:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896036.173343:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2305 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896036.173344:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:2.0:1789896036.173355:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3616:x1876838003542144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896036.173355:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7c00/0x412fd4b3617a22fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2305 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.173357:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789896036.173365:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896036.173366:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214323:x1876838003542400:12345-0@lo:104: Request processed in 94us (460us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896036.173372:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2313 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a230c expref: 24 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173377:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00010000:00010000:0.0:1789896036.173380:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789896036.173382:0:214323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a22bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a22b8 expref: 24 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.173386:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a22f7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173390:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003542784 00010000:00010000:3.0:1789896036.173391:0:214323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a22bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a22b8 expref: 24 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173395:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003542784 00010000:00010000:0.0:1789896036.173402:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a000 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896036.173406:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a22f7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173413:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1789896036.173425:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214323:x1876838003542528:12345-0@lo:104: 00010000:00010000:2.0:1789896036.173426:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2313 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a230c expref: 24 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.173427:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a22f7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.173428:0:214323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003543040:0@lo:104: 00010000:00010000:1.0:1789896036.173435:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a22e9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896036.173448:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a22f7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.173452:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:01000000:0.0:1789896036.173453:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789896036.173459:0:214323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896036.173473:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22f7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.173477:0:214323:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00010000:00010000:0.0:1789896036.173479:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896036.173486:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3616:x1876838003542144:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (251us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896036.173487:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789896036.173493:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1789896036.173493:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214323:x1876838003542528:12345-0@lo:104: Request processed in 71us (503us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896036.173493:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22f7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.173500:0:214323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2200/0x412fd4b3617a232f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2328 expref: 24 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.173513:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a000/0x412fd4b3617a22f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22f7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.173514:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789896036.173514:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:3.0:1789896036.173520:0:214323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003541504:0@lo:104: 00010000:00010000:2.0:1789896036.173522:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a22e9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.173530:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896036.173532:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c7a00 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:1.0:1789896036.173533:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003543040 00010000:00010000:0.0:1789896036.173534:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896036.173537:0:214323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2600/0x412fd4b3617a2321 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a231a expref: 22 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173538:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003543040 00010000:00010000:0.0:1789896036.173539:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789896036.173540:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a22e9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173557:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00010000:00010000:2.0:1789896036.173558:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a22e9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.173562:0:214323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003541632:0@lo:104: 00000100:00100000:1.0:1789896036.173566:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214323:x1876838003542656:12345-0@lo:104: 10000000:00010000:2.0:1789896036.173571:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a22e9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896036.173577:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896036.173577:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a22db expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.173585:0:214323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3e00/0x412fd4b3617a2313 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a230c expref: 21 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.173596:0:214323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003541760:0@lo:104: 00010000:00010000:2.0:1789896036.173601:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22e9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.173608:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789896036.173612:0:214323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003541888:0@lo:104: 00010000:00010000:2.0:1789896036.173618:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22e9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.173624:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789896036.173626:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c7a00/0x412fd4b3617a22e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22e9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173630:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950859180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214323:x1876838003542656:12345-0@lo:104: Request processed in 66us (519us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896036.173637:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789896036.173637:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00010000:00010000:2.0:1789896036.173642:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a22db expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.173643:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:2.0:1789896036.173652:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b200 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:1.0:1789896036.173653:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 10000000:00010000:2.0:1789896036.173655:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a22db expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.173664:0:214323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003542400:0@lo:104: 00010000:00010000:2.0:1789896036.173664:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a22db expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173671:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214323:x1876838003542784:12345-0@lo:104: 10000000:00010000:2.0:1789896036.173677:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a22db expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.173680:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a22cd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896036.173687:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896036.173688:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896036.173690:0:214323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950858a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003542528:0@lo:104: 00010000:00010000:2.0:1789896036.173705:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22db expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.173712:0:214323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003542656:0@lo:104: 00010000:00010000:2.0:1789896036.173715:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896036.173720:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00010000:00010000:2.0:1789896036.173727:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22db expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.173730:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214323:x1876838003543040:12345-0@lo:104: 00000100:00100000:3.0:1789896036.173731:0:214323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003542784:0@lo:104: 00010000:00010000:1.0:1789896036.173736:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789896036.173744:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a22bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173745:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214323:x1876838003542784:12345-0@lo:104: Request processed in 77us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896036.173750:0:214323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003541248:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789896036.173764:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00010000:00010000:2.0:1789896036.173766:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b200/0x412fd4b3617a22d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22db expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.173768:0:214323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa65fe3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003541376:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789896036.173784:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789896036.173784:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896036.173788:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a22cd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.173794:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9523c6800 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:2.0:1789896036.173797:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a22cd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.173805:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a22cd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173811:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003542912:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789896036.173812:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a22cd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.173818:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789896036.173819:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003543296:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1789896036.173819:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896036.173828:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:214323:x1876838003543040:12345-0@lo:104: Request processed in 99us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896036.173834:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00000100:00100000:1.0:1789896036.173844:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896036.173849:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22cd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.173853:0:192928:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789896036.173855:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789896036.173859:0:192928:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a22bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.173866:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22cd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.173866:0:192928:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b400 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:0.0:1789896036.173872:0:192928:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a22bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173879:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003543552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896036.173880:0:214323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214323:1876838003543040:0@lo:104: 00010000:00010000:2.0:1789896036.173883:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9523c6800/0x412fd4b3617a22c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22cd expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.173888:0:192928:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a22bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896036.173902:0:192928:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a22bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.173904:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789896036.173909:0:192928:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789896036.173912:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896036.173914:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896036.173918:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896036.173932:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015955072 00010000:00010000:0.0:1789896036.173933:0:192928:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896036.173936:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015955072 00000100:00100000:1.0:1789896036.173940:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789896036.173941:0:192928:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896036.173949:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003543168:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896036.173950:0:192928:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.173954:0:214323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.173958:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2336 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5f3 expref: 10 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.173970:0:192928:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a22b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a22bf expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.173976:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896036.173989:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896036.173991:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896036.173995:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896036.173996:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896036.174000:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789896036.174001:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015954944 00000100:00100000:2.0:1789896036.174005:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015954944 00000100:00100000:3.0:1789896036.174007:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003543424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896036.174011:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003542912 00000100:00100000:1.0:1789896036.174012:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003543680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896036.174017:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003542912 00010000:00010000:2.0:1789896036.174018:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a233d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5fa expref: 11 pid: 188725 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896036.174035:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003543552 00000100:00100000:3.0:1789896036.174036:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896036.174041:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003543552 00010000:00010000:0.0:1789896036.174042:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a22fe expref: 21 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.174053:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896036.174060:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a22cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a22c6 expref: 22 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.174061:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ffbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003542144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896036.174066:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003543168 00000100:00100000:0.0:1789896036.174071:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003543168 00000100:00100000:2.0:1789896036.174098:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003543424 00000100:00100000:2.0:1789896036.174103:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003543424 00010000:00010000:0.0:1789896036.174103:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d3200/0x412fd4b3617a22f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a22f0 expref: 23 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.174108:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003542016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896036.174111:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003543680 00000100:00100000:3.0:1789896036.174117:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003543680 00010000:00010000:2.0:1789896036.174121:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a22d4 expref: 24 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.174132:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 487 00010000:00010000:3.0:1789896036.174135:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a22bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a22b8 expref: 25 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.174145:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896036.174146:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6f6720b-db77-464e-82b6-5f314c431303+11:2402:x1876838015955072:12345-192.168.202.44@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789896036.174150:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 488 00000100:00100000:3.0:1789896036.174163:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00010000:00010000:0.0:1789896036.174163:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896036.174164:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a51050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f6720b-db77-464e-82b6-5f314c431303+11:2404:x1876838015954944:12345-192.168.202.44@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789896036.174166:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003542272:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896036.174172:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2336 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5f3 expref: 11 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.174176:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789896036.174177:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa72d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3617:x1876838003542912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896036.174189:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896036.174189:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5f3 expref: 11 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.174190:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a233d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5fa expref: 11 pid: 188725 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.174220:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2305 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a22fe expref: 25 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.174221:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003543296 00010000:00010000:0.0:1789896036.174224:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a2336 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5f3 expref: 11 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.174227:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003543296 00010000:00010000:2.0:1789896036.174229:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a233d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5fa expref: 11 pid: 188725 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.174244:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a22e2 expref: 26 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.174259:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a22fe expref: 26 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.174266:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896036.174270:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00010000:00010000:2.0:1789896036.174273:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a233d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f5fa expref: 10 pid: 188725 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.174279:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2800/0x412fd4b3617a2305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a22fe expref: 26 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.174280:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3617:x1876838003543552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896036.174287:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896036.174294:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a6f6720b-db77-464e-82b6-5f314c431303+9:2402:x1876838015955072:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 154us (654us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896036.174295:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896036.174298:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896036.174304:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a22cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a22c6 expref: 25 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.174306:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 487 00000100:00100000:2.0:1789896036.174313:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a51050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f6720b-db77-464e-82b6-5f314c431303+9:2404:x1876838015954944:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 154us (630us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896036.174317:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a22cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a22c6 expref: 25 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896036.174321:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 488 00000100:00100000:0.0:1789896036.174327:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00010000:00010000:1.0:1789896036.174331:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2400/0x412fd4b3617a22cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a22c6 expref: 25 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.174339:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+25:3617:x1876838003543168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896036.174344:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789896036.174346:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa72d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3617:x1876838003542912:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (500us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896036.174349:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896036.174357:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d3200/0x412fd4b3617a22f7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a22f0 expref: 24 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.174358:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00010000:00010000:0.0:1789896036.174366:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d3200/0x412fd4b3617a22f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a22f0 expref: 24 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896036.174371:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1789896036.174375:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950859500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3617:x1876838003543552:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896036.174383:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00010000:00010000:0.0:1789896036.174385:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3200/0x412fd4b3617a22f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a22f0 expref: 23 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896036.174388:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3616:x1876838003543424:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896036.174396:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1789896036.174397:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3617:x1876838003543680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896036.174401:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896036.174404:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896036.174407:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896036.174412:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a22d4 expref: 21 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.174414:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a22bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a22b8 expref: 21 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.174420:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1789896036.174427:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3617:x1876838003543168:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (453us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896036.174434:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a22d4 expref: 21 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.174434:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3615:x1876838003543296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896036.174443:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896036.174449:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a22e2 expref: 21 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.174453:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00010000:00010000:3.0:1789896036.174454:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a22bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a22b8 expref: 21 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.174475:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3800/0x412fd4b3617a22db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a22d4 expref: 20 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.174476:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a22e2 expref: 20 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.174491:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d2c00/0x412fd4b3617a22bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a22b8 expref: 19 pid: 188726 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.174498:0:188716:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.174498:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3a00/0x412fd4b3617a22e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a22e2 expref: 19 pid: 188723 timeout: 4008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.174507:0:188716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.174516:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896036.174521:0:188716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.174521:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896036.174529:0:188716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896036.174538:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896036.174545:0:188716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896036.174550:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:3617:x1876838003543680:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (499us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896036.174558:0:188716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.174559:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003543680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896036.174565:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1789896036.174567:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:3615:x1876838003543296:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (425us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896036.174574:0:188716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3600 already unused, calling callback (ffffffffc0c2e250) 00000100:00100000:0.0:1789896036.174575:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003543168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896036.174578:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00010000:00010000:2.0:1789896036.174581:0:188716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896036.174589:0:188716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896036.174589:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003543552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896036.174605:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003542912:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896036.174607:0:188716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896036.174613:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003543296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896036.174620:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896036.174641:0:214323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.174648:0:214323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.174653:0:214323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3600/0x412fd4b3617a2344 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896036.174656:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b75500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3616:x1876838003543424:12345-0@lo:103:ldlm_bl.0 Request processed in 274us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896036.174666:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:1.0:1789896036.174679:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003543424:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1789896036.174725:0:214323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd17e7ded0 20000000:00000080:3.0:1789896036.174732:0:214323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91a94db39400 uarg=0000000000000000 00000040:00100000:3.0:1789896036.175182:0:214323:0:(llog.c:1072:llog_reverse_process()) index 164 : idx 137 20000000:01000000:3.0:1789896036.175187:0:214323:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 160 cmd:0xce020 lustre.qpool1 00000040:00080000:3.0:1789896036.175236:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].165, 224 off38304 20000000:01000000:3.0:1789896036.175254:0:214323:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1789896036.175265:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].166, 128 off38432 00000040:00080000:3.0:1789896036.175278:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].167, 224 off38656 00000040:00080000:3.0:1789896036.175313:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].191, 224 off43088 20000000:01000000:3.0:1789896036.175323:0:214323:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1789896036.175339:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].192, 136 off43224 00000040:00080000:3.0:1789896036.175357:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].193, 224 off43448 00000040:00080000:3.0:1789896036.175401:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].191, 224 off43088 20000000:01000000:3.0:1789896036.175408:0:214323:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:3.0:1789896036.175418:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].192, 136 off43224 00000040:00080000:3.0:1789896036.175432:0:214323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].193, 224 off43448 10000000:01000000:3.0:1789896036.175441:0:214323:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789896036.175452:0:214323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a234b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.175461:0:214323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a234b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.175468:0:214323:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a234b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.175474:0:214323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a234b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.175479:0:214323:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a234b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.175485:0:214323:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a234b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.175490:0:214323:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3c00 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:3.0:1789896036.175492:0:214323:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a234b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.175504:0:214323:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a234b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.175519:0:214323:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a234b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.175525:0:214323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a234b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896036.175531:0:214323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a9512d3c00/0x412fd4b3617a234b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896036.332354:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789896036.780391:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003543936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789896036.780462:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896036.780498:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003543808:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789896036.780506:0:196139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003543936 00000100:00100000:0.0:1789896036.780514:0:196139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003543936 00000100:00100000:1.0:1789896036.780526:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789896036.780557:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789896036.780574:0:196139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789896036.780584:0:196139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003543936:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789896036.780589:0:188735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003543808 00000100:00100000:3.0:1789896036.780594:0:188735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003543808 00002000:00000024:0.0:1789896036.780613:0:196139:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789896036.780627:0:188735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789896036.780633:0:188735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa72d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003543808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789896036.780658:0:188735:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00100000:0.0:1789896036.780667:0:196139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003543936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896036.780673:0:196139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789896036.780690:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003543936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789896036.780706:0:188735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa72d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003543808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896036.780712:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003543808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789896036.780713:0:188735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789896037.237227:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896037.237306:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015955200 00000100:00100000:2.0:1789896037.237316:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015955200 00000100:00100000:2.0:1789896037.237368:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2075 00000100:00100000:2.0:1789896037.237377:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015955200:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896037.237393:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896037.237411:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f601 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.237455:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f601 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.237467:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f601 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.237475:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9800, rc 0) 00000100:00100000:2.0:1789896037.237526:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015955200:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 150us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.237533:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2075 00000100:00100000:0.0:1789896037.238554:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896037.238607:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015955328 00000100:00100000:2.0:1789896037.238613:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015955328 00000100:00100000:2.0:1789896037.238642:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2076 00000100:00100000:2.0:1789896037.238649:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015955328:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.238770:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015955328:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 121us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.238778:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2076 00000100:00100000:0.0:1789896037.239513:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896037.239552:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015955456 00000100:00100000:2.0:1789896037.239557:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015955456 00000100:00100000:2.0:1789896037.239585:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2077 00000100:00100000:2.0:1789896037.239592:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015955456:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.239669:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015955456:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 76us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.239676:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2077 00000100:00100000:0.0:1789896037.240675:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896037.240717:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015955584 00000100:00100000:2.0:1789896037.240725:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015955584 00000100:00100000:2.0:1789896037.240751:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2078 00000100:00100000:2.0:1789896037.240756:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:213721:x1876838015955584:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896037.240831:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:213721:x1876838015955584:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 73us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.240839:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2078 00000100:00100000:0.0:1789896037.241631:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896037.241672:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015955712 00000100:00100000:2.0:1789896037.241676:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015955712 00000100:00100000:2.0:1789896037.241702:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2079 00000100:00100000:2.0:1789896037.241708:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:213721:x1876838015955712:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896037.241777:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:213721:x1876838015955712:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 69us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.241782:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2079 00000100:00100000:0.0:1789896037.242761:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896037.242806:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015955840 00000100:00100000:2.0:1789896037.242811:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015955840 00000100:00100000:2.0:1789896037.242838:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2080 00000100:00100000:2.0:1789896037.242845:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015955840:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896037.242855:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896037.242870:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f608 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.242891:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f608 expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.242903:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f608 expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.242924:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9000, rc 0) 00000100:00100000:2.0:1789896037.242947:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015955840:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 104us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.242952:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2080 00000100:00100000:0.0:1789896037.243657:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896037.243700:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015955968 00000100:00100000:2.0:1789896037.243705:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015955968 00000100:00100000:2.0:1789896037.243742:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2081 00000100:00100000:2.0:1789896037.243758:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015955968:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.243822:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015955968:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 72us (165us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789896037.243829:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2081 00010000:00010000:2.0:1789896037.356334:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789896037.484297:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896037.484304:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 162 10000000:01000000:0.0:1789896037.484308:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896037.484350:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896037.484368:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896037.484377:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896037.484398:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003544064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.484455:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.484496:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27780 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.484531:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003544064 00000100:00100000:2.0:1789896037.484540:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003544064 00000100:00100000:2.0:1789896037.484593:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2082 00000100:00100000:2.0:1789896037.484602:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003544064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896037.484615:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896037.484631:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2360 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.484656:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2360 expref: 16 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.484667:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2360 expref: 16 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.484688:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8a00, rc 0) 00000100:00100000:2.0:1789896037.484738:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003544064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.484746:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2082 00000100:00100000:0.0:1789896037.484968:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003544064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896037.484984:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2367 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896037.484994:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2367 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896037.485051:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003544192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.485091:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.485108:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27780 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.485136:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003544192 00000100:00100000:2.0:1789896037.485141:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003544192 00000100:00100000:2.0:1789896037.485169:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:2.0:1789896037.485176:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003544192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.485321:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003544192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.485329:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00100000:0.0:1789896037.485363:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003544192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.485391:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003544320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.485428:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.485452:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27780 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.485470:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003544320 00000100:00100000:2.0:1789896037.485475:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003544320 00000100:00100000:2.0:1789896037.485503:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:2.0:1789896037.485510:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003544320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.485597:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003544320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.485605:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00100000:0.0:1789896037.485633:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003544320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.485896:0:214324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214324:1876838003544448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896037.485934:0:214324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.485951:0:214324:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.485975:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003544448 00000100:00100000:2.0:1789896037.485980:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003544448 00000100:00100000:2.0:1789896037.486008:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:2.0:1789896037.486014:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214324:x1876838003544448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896037.486105:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214324:x1876838003544448:12345-0@lo:502:llog_process_th.0 Request processed in 90us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.486112:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00100000:0.0:1789896037.486137:0:214324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214324:1876838003544448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896037.486178:0:214324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214324:1876838003544576:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896037.486226:0:214324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.486247:0:214324:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.486258:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003544576 00000100:00100000:2.0:1789896037.486262:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003544576 00000100:00100000:2.0:1789896037.486281:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:2.0:1789896037.486285:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214324:x1876838003544576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896037.486335:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214324:x1876838003544576:12345-0@lo:502:llog_process_th.0 Request processed in 49us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.486340:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000100:00100000:0.0:1789896037.486359:0:214324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214324:1876838003544576:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896037.486383:0:214324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 168 count 165 00000020:01000000:3.0:1789896037.486458:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 162-167 (rc=0) 10000000:01000000:3.0:1789896037.486488:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896037.486497:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2367 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.486507:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2367 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896037.486535:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789896037.486537:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:3.0:1789896037.486540:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789896037.486557:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.486564:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.486579:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.486592:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003544704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.486619:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.486635:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.486651:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003544704 00000100:00100000:2.0:1789896037.486655:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003544704 00000100:00100000:2.0:1789896037.486674:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:2.0:1789896037.486678:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003544704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896037.486683:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896037.486691:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2375 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a236e expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.486702:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a236e expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.486707:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a236e expref: 17 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.486712:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8200, rc 0) 00000100:00100000:2.0:1789896037.486736:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003544704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 57us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.486739:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00100000:3.0:1789896037.486769:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003544704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896037.486780:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2375 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.486789:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2375 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.486837:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003544832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.486860:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.486882:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.486891:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003544832 00000100:00100000:2.0:1789896037.486900:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003544832 00000100:00100000:2.0:1789896037.486918:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:2.0:1789896037.486923:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003544832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.486984:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003544832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.486989:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00100000:3.0:1789896037.487016:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003544832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.487051:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003544960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.487097:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.487113:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.487135:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003544960 00000100:00100000:2.0:1789896037.487139:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003544960 00000100:00100000:2.0:1789896037.487157:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:2.0:1789896037.487162:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003544960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.487234:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003544960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.487239:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:3.0:1789896037.487271:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003544960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789896037.487921:0:214325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:3.0:1789896037.487999:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:3.0:1789896037.488017:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789896037.488023:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2375 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.488031:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2375 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896037.488038:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789896037.488040:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 162 10000000:01000000:3.0:1789896037.488042:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789896037.488056:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.488077:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.488085:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.488098:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003545088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.488122:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.488143:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.488163:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003545088 00000100:00100000:2.0:1789896037.488169:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003545088 00000100:00100000:2.0:1789896037.488190:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:2.0:1789896037.488226:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003545088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896037.488233:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896037.488242:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2383 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a237c expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.488256:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a237c expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.488264:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a237c expref: 18 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.488270:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8e00, rc 0) 00000100:00100000:2.0:1789896037.488302:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003545088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.488317:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00000100:00100000:3.0:1789896037.488332:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003545088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896037.488352:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2383 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.488360:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2383 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.488396:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003545216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.488420:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.488446:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.488451:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003545216 00000100:00100000:2.0:1789896037.488454:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003545216 00000100:00100000:2.0:1789896037.488470:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091 00000100:00100000:2.0:1789896037.488475:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003545216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.488525:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003545216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 50us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.488530:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091 00000100:00100000:3.0:1789896037.488550:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003545216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.488586:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003545344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.488617:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.488634:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.488642:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003545344 00000100:00100000:2.0:1789896037.488646:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003545344 00000100:00100000:2.0:1789896037.488664:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:2.0:1789896037.488668:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003545344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.488731:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003545344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.488739:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00100000:3.0:1789896037.488746:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003545344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.488983:0:214326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214326:1876838003545472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896037.489030:0:214326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.489050:0:214326:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.489084:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003545472 00000100:00100000:2.0:1789896037.489089:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003545472 00000100:00100000:2.0:1789896037.489111:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:2.0:1789896037.489118:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214326:x1876838003545472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896037.489187:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214326:x1876838003545472:12345-0@lo:502:llog_process_th.0 Request processed in 69us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.489194:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00100000:0.0:1789896037.489238:0:214326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214326:1876838003545472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896037.489278:0:214326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214326:1876838003545600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896037.489325:0:214326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.489350:0:214326:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d9900 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.489645:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003545600 00000100:00100000:2.0:1789896037.489650:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003545600 00000100:00100000:2.0:1789896037.489675:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:2.0:1789896037.489682:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214326:x1876838003545600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896037.489759:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214326:x1876838003545600:12345-0@lo:502:llog_process_th.0 Request processed in 77us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.489765:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00100000:0.0:1789896037.489834:0:214326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214326:1876838003545600:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896037.489855:0:214326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 168 count 165 00000020:01000000:3.0:1789896037.489935:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 162-167 (rc=0) 10000000:01000000:3.0:1789896037.489951:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896037.489956:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2383 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.489965:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2383 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896037.489972:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789896037.489975:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:3.0:1789896037.489977:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789896037.489992:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.490009:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.490017:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.490030:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003545728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.490057:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.490087:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.490106:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003545728 00000100:00100000:2.0:1789896037.490111:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003545728 00000100:00100000:2.0:1789896037.490140:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:2.0:1789896037.490147:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003545728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896037.490154:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896037.490163:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a238a expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.490177:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a238a expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.490185:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a238a expref: 19 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.490191:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8000, rc 0) 00000100:00100000:2.0:1789896037.490242:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003545728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.490250:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:3.0:1789896037.490262:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003545728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896037.490275:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2391 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.490284:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2391 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.490324:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003545856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.490349:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.490372:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.490391:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003545856 00000100:00100000:2.0:1789896037.490396:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003545856 00000100:00100000:2.0:1789896037.490420:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:2.0:1789896037.490427:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003545856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.490498:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003545856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.490513:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:3.0:1789896037.490518:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003545856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.490549:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003545984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.490582:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.490597:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.490609:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003545984 00000100:00100000:2.0:1789896037.490614:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003545984 00000100:00100000:2.0:1789896037.490639:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:2.0:1789896037.490646:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003545984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.490714:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003545984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.490722:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00100000:3.0:1789896037.490736:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003545984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789896037.491438:0:214327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:3.0:1789896037.491505:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:3.0:1789896037.491528:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789896037.491534:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2391 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.491543:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2391 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896037.491551:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789896037.491552:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 162 10000000:01000000:3.0:1789896037.491555:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789896037.491570:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.491577:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.491584:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.491596:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003546112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.491624:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.491648:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.491670:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003546112 00000100:00100000:2.0:1789896037.491675:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003546112 00000100:00100000:2.0:1789896037.491701:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2098 00000100:00100000:2.0:1789896037.491708:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003546112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896037.491716:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896037.491726:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a239f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2398 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.491739:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a239f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2398 expref: 20 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.491746:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a239f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2398 expref: 20 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.491752:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8600, rc 0) 00000100:00100000:2.0:1789896037.491786:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003546112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.491793:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2098 00000100:00100000:3.0:1789896037.491807:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003546112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896037.491820:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a239f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.491828:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a239f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.491867:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003546240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.491899:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.491920:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.491953:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003546240 00000100:00100000:2.0:1789896037.491963:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003546240 00000100:00100000:2.0:1789896037.491989:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:2.0:1789896037.491996:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003546240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.492082:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003546240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.492091:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00100000:3.0:1789896037.492101:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003546240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.492132:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003546368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.492163:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.492188:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.492223:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003546368 00000100:00100000:2.0:1789896037.492227:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003546368 00000100:00100000:2.0:1789896037.492255:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:2.0:1789896037.492264:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003546368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.492358:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003546368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 95us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.492365:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:1.0:1789896037.492384:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003546368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789896037.492647:0:214328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214328:1876838003546496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896037.492682:0:214328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896037.492708:0:214328:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa42a78540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.492735:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003546496 00000100:00100000:2.0:1789896037.492740:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003546496 00000100:00100000:2.0:1789896037.492767:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:2.0:1789896037.492774:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214328:x1876838003546496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896037.492855:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214328:x1876838003546496:12345-0@lo:502:llog_process_th.0 Request processed in 82us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.492864:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00100000:1.0:1789896037.492896:0:214328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214328:1876838003546496:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896037.492938:0:214328:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214328:1876838003546624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896037.492972:0:214328:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896037.492999:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003546624 00000100:00100000:1.0:1789896037.493001:0:214328:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa42a78540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.493004:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003546624 00000100:00100000:2.0:1789896037.493038:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2102 00000100:00100000:2.0:1789896037.493045:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214328:x1876838003546624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896037.493123:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214328:x1876838003546624:12345-0@lo:502:llog_process_th.0 Request processed in 78us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.493140:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2102 00000100:00100000:1.0:1789896037.493143:0:214328:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214328:1876838003546624:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789896037.493168:0:214328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 168 count 165 00000020:01000000:0.0:1789896037.493255:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 162-167 (rc=0) 10000000:01000000:0.0:1789896037.493278:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896037.493285:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a239f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896037.493304:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a239f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896037.493311:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789896037.493313:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 188 10000000:01000000:0.0:1789896037.493315:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789896037.493330:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896037.493337:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896037.493345:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896037.493358:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003546752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.493385:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.493415:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.493420:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003546752 00000100:00100000:2.0:1789896037.493426:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003546752 00000100:00100000:2.0:1789896037.493454:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:2.0:1789896037.493461:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003546752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896037.493468:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896037.493476:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a23ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a23a6 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.493491:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a23ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a23a6 expref: 21 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.493499:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a23ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a23a6 expref: 21 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.493507:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9600, rc 0) 00000100:00100000:2.0:1789896037.493554:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003546752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.493561:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:0.0:1789896037.493622:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003546752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896037.493630:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23ad expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896037.493636:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a23ad expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896037.493663:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003546880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.493681:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.493703:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789896037.493718:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003546880 00000100:00100000:3.0:1789896037.493723:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003546880 00000100:00100000:3.0:1789896037.493744:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:3.0:1789896037.493749:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003546880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.493806:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003546880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896037.493811:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:0.0:1789896037.493888:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003546880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.493913:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003547008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.493943:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.493961:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.493975:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003547008 00000100:00100000:2.0:1789896037.493981:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003547008 00000100:00100000:2.0:1789896037.494008:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:2.0:1789896037.494015:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003547008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.494098:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003547008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.494106:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:0.0:1789896037.494122:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003547008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.494328:0:214329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214329:1876838003547136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896037.494360:0:214329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.494380:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003547136 00000100:00100000:3.0:1789896037.494384:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003547136 00000100:00100000:0.0:1789896037.494385:0:214329:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d9540 going to sleep for 11 seconds 00000100:00100000:3.0:1789896037.494406:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2106 00000100:00100000:3.0:1789896037.494412:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214329:x1876838003547136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896037.494476:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214329:x1876838003547136:12345-0@lo:502:llog_process_th.0 Request processed in 64us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896037.494482:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2106 00000100:00100000:0.0:1789896037.494491:0:214329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214329:1876838003547136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896037.494515:0:214329:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789896037.494524:0:214329:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896037.494526:0:214329:0:(obd_config.c:1561:class_process_config()) marker 178 (0x1) lustre-MDT0001-m add lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:0.0:1789896037.494532:0:214329:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1789896037.494546:0:214329:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0000_UUID to qpool1 as member 1 00000020:01000000:0.0:1789896037.494550:0:214329:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789896037.494552:0:214329:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896037.494553:0:214329:0:(obd_config.c:1561:class_process_config()) marker 178 (0x2) lustre-MDT0001-m add lustre.qpool1.lustre-OST0000_UUID 00000020:01000000:0.0:1789896037.494556:0:214329:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789896037.494558:0:214329:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896037.494560:0:214329:0:(obd_config.c:1561:class_process_config()) marker 181 (0x1) lustre-MDT0001-m add lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:0.0:1789896037.494563:0:214329:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1789896037.494567:0:214329:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool1 as member 2 00000100:00100000:0.0:1789896037.494581:0:214329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214329:1876838003547264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896037.494611:0:214329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.494628:0:214329:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9533d9540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.494631:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003547264 00000100:00100000:2.0:1789896037.494641:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003547264 00000100:00100000:2.0:1789896037.494663:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:2.0:1789896037.494667:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214329:x1876838003547264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896037.494727:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214329:x1876838003547264:12345-0@lo:502:llog_process_th.0 Request processed in 58us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.494735:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:0.0:1789896037.494738:0:214329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214329:1876838003547264:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896037.494763:0:214329:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789896037.494767:0:214329:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896037.494769:0:214329:0:(obd_config.c:1561:class_process_config()) marker 181 (0x2) lustre-MDT0001-m add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:0.0:1789896037.494772:0:214329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 194 count 190 00000020:01000000:3.0:1789896037.494825:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 188-193 (rc=0) 10000000:01000000:3.0:1789896037.494849:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789896037.494856:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23ad expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.494865:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23ad expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896037.494880:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789896037.494882:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 162 10000000:01000000:3.0:1789896037.494884:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789896037.494899:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.494906:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.494914:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.494927:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003547392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.494953:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.494973:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896037.494988:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003547392 00000100:00100000:0.0:1789896037.494993:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003547392 00000100:00100000:0.0:1789896037.495024:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:0.0:1789896037.495032:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003547392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896037.495040:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896037.495048:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a23bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a23b4 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896037.495073:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a23bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a23b4 expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896037.495083:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a23bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a23b4 expref: 22 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896037.495090:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a400, rc 0) 00000100:00100000:0.0:1789896037.495122:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003547392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896037.495129:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00100000:3.0:1789896037.495141:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003547392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896037.495154:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23bb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.495162:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a23bb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.495194:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003547520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.495249:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896037.495271:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003547520 00000100:00100000:3.0:1789896037.495276:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.495277:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003547520 00000100:00100000:2.0:1789896037.495305:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:2.0:1789896037.495314:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003547520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.495382:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003547520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.495390:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00100000:3.0:1789896037.495398:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003547520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.495433:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003547648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.495466:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.495483:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896037.495499:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003547648 00000100:00100000:0.0:1789896037.495504:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003547648 00000100:00100000:0.0:1789896037.495528:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2110 00000100:00100000:0.0:1789896037.495535:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003547648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.495596:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003547648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896037.495611:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003547648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.495614:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2110 00000100:00100000:0.0:1789896037.495824:0:214330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214330:1876838003547776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896037.495854:0:214330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.495872:0:214330:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa46895f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.495900:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003547776 00000100:00100000:2.0:1789896037.495905:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003547776 00000100:00100000:2.0:1789896037.495927:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00100000:2.0:1789896037.495932:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214330:x1876838003547776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896037.495992:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214330:x1876838003547776:12345-0@lo:502:llog_process_th.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896037.496003:0:214330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214330:1876838003547776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896037.496014:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000100:00100000:0.0:1789896037.496037:0:214330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214330:1876838003547904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896037.496082:0:214330:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.496100:0:214330:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa46895f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789896037.496110:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003547904 00000100:00100000:3.0:1789896037.496114:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003547904 00000100:00100000:3.0:1789896037.496135:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112 00000100:00100000:3.0:1789896037.496143:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214330:x1876838003547904:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896037.496244:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214330:x1876838003547904:12345-0@lo:502:llog_process_th.0 Request processed in 101us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896037.496252:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112 00000100:00100000:0.0:1789896037.496320:0:214330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214330:1876838003547904:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896037.496338:0:214330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 168 count 165 00000020:01000000:3.0:1789896037.496386:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 162-167 (rc=0) 10000000:01000000:3.0:1789896037.496409:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896037.496414:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23bb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.496423:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23bb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896037.496430:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789896037.496432:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 188 10000000:01000000:3.0:1789896037.496434:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789896037.496447:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.496454:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.496470:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.496481:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003548032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.496506:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.496530:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.496553:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003548032 00000100:00100000:2.0:1789896037.496558:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003548032 00000100:00100000:2.0:1789896037.496584:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:2.0:1789896037.496590:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003548032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896037.496596:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896037.496602:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a23c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a23c2 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.496617:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a23c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a23c2 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.496622:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a23c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a23c2 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896037.496627:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8400, rc 0) 00000100:00100000:2.0:1789896037.496650:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003548032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.496654:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00100000:3.0:1789896037.496671:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003548032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896037.496684:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23c9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.496692:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a23c9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.496727:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003548160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.496751:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.496768:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:0.0:1789896037.496786:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003548160 00000100:00100000:0.0:1789896037.496790:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003548160 00000100:00100000:0.0:1789896037.496809:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2114 00000100:00100000:0.0:1789896037.496815:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003548160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.496864:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003548160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 50us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896037.496869:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2114 00000100:00100000:3.0:1789896037.496877:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003548160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.496896:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003548288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.496921:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.496934:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948f15840 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.496965:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003548288 00000100:00100000:2.0:1789896037.496970:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003548288 00000100:00100000:2.0:1789896037.496996:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:2.0:1789896037.497005:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003548288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.497071:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003548288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896037.497078:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:3.0:1789896037.497092:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003548288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896037.497270:0:214331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214331:1876838003548416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896037.497295:0:214331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.497315:0:214331:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa46895240 going to sleep for 11 seconds 00000100:00100000:3.0:1789896037.497325:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003548416 00000100:00100000:3.0:1789896037.497330:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003548416 00000100:00100000:3.0:1789896037.497360:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:3.0:1789896037.497367:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214331:x1876838003548416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896037.497453:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214331:x1876838003548416:12345-0@lo:502:llog_process_th.0 Request processed in 86us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896037.497461:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:0.0:1789896037.497479:0:214331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214331:1876838003548416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896037.497503:0:214331:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789896037.497510:0:214331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896037.497516:0:214331:0:(obd_config.c:1561:class_process_config()) marker 177 (0x1) lustre-MDT0000-m add lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:0.0:1789896037.497522:0:214331:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:0.0:1789896037.497531:0:214331:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0000_UUID to qpool1 as member 1 00000020:01000000:2.0:1789896037.497785:0:214331:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789896037.497789:0:214331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896037.497791:0:214331:0:(obd_config.c:1561:class_process_config()) marker 177 (0x2) lustre-MDT0000-m add lustre.qpool1.lustre-OST0000_UUID 00000020:01000004:0.0:1789896037.497792:0:214332:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a952404000 from lustre-MDT0000, refs=4 00000020:01000000:2.0:1789896037.497794:0:214331:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789896037.497797:0:214332:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a952404000 4 00000020:00000080:2.0:1789896037.497799:0:214331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896037.497801:0:214331:0:(obd_config.c:1561:class_process_config()) marker 180 (0x1) lustre-MDT0000-m add lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:2.0:1789896037.497805:0:214331:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1789896037.497812:0:214331:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool1 as member 2 00000020:01000004:2.0:1789896037.498122:0:214333:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a952404000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789896037.498126:0:214333:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a952404000 4 00000100:00100000:0.0:1789896037.498126:0:214331:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214331:1876838003548544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896037.498161:0:214331:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896037.498181:0:214331:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27780 going to sleep for 11 seconds 00000100:00100000:3.0:1789896037.498240:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003548544 00000100:00100000:3.0:1789896037.498246:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003548544 00000100:00100000:3.0:1789896037.498285:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:3.0:1789896037.498294:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214331:x1876838003548544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896037.498363:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214331:x1876838003548544:12345-0@lo:502:llog_process_th.0 Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896037.498371:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:0.0:1789896037.498373:0:214331:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea07480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214331:1876838003548544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896037.498393:0:214331:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789896037.498396:0:214331:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896037.498397:0:214331:0:(obd_config.c:1561:class_process_config()) marker 180 (0x2) lustre-MDT0000-m add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:0.0:1789896037.498400:0:214331:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 194 count 190 00000020:01000000:3.0:1789896037.498442:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 188-193 (rc=0) 10000000:01000000:3.0:1789896037.498460:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789896037.498464:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23c9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.498471:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23c9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896037.498476:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789896037.498477:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:3.0:1789896037.498478:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789896037.498488:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.498493:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.498498:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.498511:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003548672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.498528:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.498545:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5009b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896037.498552:0:188723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003548672 00000100:00100000:0.0:1789896037.498558:0:188723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003548672 00000100:00100000:0.0:1789896037.498594:0:188723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2118 00000100:00100000:0.0:1789896037.498601:0:188723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003548672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896037.498608:0:188723:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896037.498615:0:188723:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a23d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a23d0 expref: -99 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896037.498630:0:188723:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a23d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a23d0 expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896037.498638:0:188723:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a23d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a23d0 expref: 24 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896037.498645:0:188723:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b200, rc 0) 00000100:00100000:0.0:1789896037.498681:0:188723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003548672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896037.498695:0:188723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2118 00000100:00100000:3.0:1789896037.498699:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003548672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896037.498711:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23d7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.498717:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a23d7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896037.498749:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003548800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896037.498773:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896037.498791:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5009b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896037.498797:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003548800 00000100:00100000:2.0:1789896037.498806:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003548800 00000100:00100000:2.0:1789896037.498830:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1789896037.498834:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003548800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896037.498873:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003548800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 38us (99us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789896037.498878:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:3.0:1789896037.498897:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003548800:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789896037.498920:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789896037.498925:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23d7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896037.498933:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23d7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.380285:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896038.509044:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896038.509094:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015956096 00000100:00100000:3.0:1789896038.509102:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015956096 00000100:00080000:2.0:1789896038.509156:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789896038.509174:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2792 00000100:00100000:3.0:1789896038.509186:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213741:x1876838015956096:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:3.0:1789896038.510570:0:190608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:190608:1876838003548928:0@lo:19:mdt00_003.0 00000100:00100000:3.0:1789896038.510618:0:190608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896038.510645:0:190608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:190608:1876838003549056:0@lo:19:mdt00_003.0 00000100:00100000:0.0:1789896038.510653:0:190235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003548928 00000100:00100000:0.0:1789896038.510658:0:190235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003548928 00000100:00100000:3.0:1789896038.510663:0:190608:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896038.510680:0:190608:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789896038.510700:0:190235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003549056 00000100:00100000:0.0:1789896038.510703:0:190235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003549056 00000100:00100000:3.0:1789896038.510707:0:191519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789896038.510717:0:191519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:190608:x1876838003548928:12345-0@lo:19:mdt00_003.0 00000100:00080000:2.0:1789896038.510723:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789896038.510728:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789896038.510733:0:190235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789896038.510742:0:190235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:190608:x1876838003549056:12345-0@lo:19:mdt00_003.0 00000100:00100000:3.0:1789896038.510882:0:191519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:190608:x1876838003548928:12345-0@lo:19:mdt00_003.0 Request processed in 162us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896038.510889:0:191519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789896038.510927:0:190235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:190608:x1876838003549056:12345-0@lo:19:mdt00_003.0 Request processed in 186us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896038.510930:0:190608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:190608:1876838003548928:0@lo:19:mdt00_003.0 00000100:00100000:0.0:1789896038.510942:0:190235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789896038.510954:0:190608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:190608:1876838003549056:0@lo:19:mdt00_003.0 00000100:00100000:2.0:1789896038.511033:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213741:x1876838015956096:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1850us (1993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896038.511040:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2792 00000100:00100000:0.0:1789896038.512086:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896038.512121:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015956224 00000100:00100000:3.0:1789896038.512126:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015956224 00000100:00100000:3.0:1789896038.512156:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2793 00000100:00100000:3.0:1789896038.512164:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213741:x1876838015956224:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:1.0:1789896038.514938:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213741:x1876838015956224:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 2767us (2846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896038.514954:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2793 00000020:00000080:2.0:1789896038.787940:0:214434:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fffcb252170 20000000:00000080:2.0:1789896038.787956:0:214434:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91a9478b1c00 uarg=0000000000000000 00000040:00100000:2.0:1789896038.788760:0:214434:0:(llog.c:1072:llog_reverse_process()) index 167 : idx 137 20000000:01000000:2.0:1789896038.788767:0:214434:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 157 cmd:0xce023 lustre.qpool2 00000040:00080000:2.0:1789896038.788846:0:214434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].168, 224 off38880 20000000:01000000:2.0:1789896038.788864:0:214434:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre qpool2 (null) (null) 00000040:00080000:2.0:1789896038.788879:0:214434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].169, 104 off38984 00000040:00080000:2.0:1789896038.788898:0:214434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].170, 224 off39208 00000040:00080000:2.0:1789896038.788955:0:214434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].194, 224 off43672 20000000:01000000:2.0:1789896038.788964:0:214434:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre qpool2 (null) (null) 00000040:00080000:2.0:1789896038.788978:0:214434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].195, 112 off43784 00000040:00080000:2.0:1789896038.788993:0:214434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].196, 224 off44008 00000040:00080000:2.0:1789896038.789046:0:214434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].194, 224 off43672 20000000:01000000:2.0:1789896038.789066:0:214434:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre qpool2 (null) (null) 00000040:00080000:2.0:1789896038.789089:0:214434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].195, 112 off43784 00000040:00080000:2.0:1789896038.789104:0:214434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].196, 224 off44008 10000000:01000000:2.0:1789896038.789114:0:214434:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789896038.789133:0:214434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789151:0:214434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f601 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789160:0:214434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f608 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789167:0:214434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2360 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789174:0:214434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2375 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a236e expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789181:0:214434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a237c expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789188:0:214434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a238a expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789194:0:214434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a239f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2398 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789232:0:214434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a23ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a23a6 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789239:0:214434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a23bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a23b4 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789253:0:214434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a23c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a23c2 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789259:0:214434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a23d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a23d0 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789267:0:214434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789304:0:214434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a23d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a23d0 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789317:0:214434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a23d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a23d0 expref: 23 pid: 188723 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.789332:0:214434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950b41c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549184:0@lo:104: 00000100:00100000:2.0:1789896038.789390:0:214434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896038.789431:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003549184 00000100:00100000:1.0:1789896038.789439:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003549184 00010000:00010000:2.0:1789896038.789444:0:214434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a23c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a23c2 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789454:0:214434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a23c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a23c2 expref: 23 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.789463:0:214434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549312:0@lo:104: 00000100:00100000:1.0:1789896038.789479:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1789896038.789495:0:214434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896038.789496:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:214434:x1876838003549184:12345-0@lo:104: 00010000:00010000:1.0:1789896038.789511:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a23d7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789524:0:214434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a23bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a23b4 expref: 23 pid: 188723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789533:0:214434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a23bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a23b4 expref: 23 pid: 188723 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.789549:0:214434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549440:0@lo:104: 00000100:00100000:3.0:1789896038.789565:0:189482:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789896038.789572:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789896038.789580:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:214434:x1876838003549184:12345-0@lo:104: Request processed in 91us (189us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896038.789587:0:214434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a23ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a23a6 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896038.789593:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789896038.789597:0:189482:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896038.789607:0:214434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a23ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a23a6 expref: 23 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896038.789623:0:189482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003549312 00000100:00100000:1.0:1789896038.789626:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003549440 00000100:00100000:3.0:1789896038.789629:0:189482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003549312 00000100:00100000:1.0:1789896038.789632:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003549440 00000100:00100000:2.0:1789896038.789687:0:214434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549568:0@lo:104: 00000100:00100000:3.0:1789896038.789731:0:189482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:2.0:1789896038.789732:0:214434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896038.789742:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1789896038.789747:0:189482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa724ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214434:x1876838003549312:12345-0@lo:104: 00000100:00100000:1.0:1789896038.789754:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214434:x1876838003549440:12345-0@lo:104: 00010000:00010000:3.0:1789896038.789758:0:189482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a23c9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789759:0:214434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a239f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2398 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.789767:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a23bb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.789783:0:214434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a239f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2398 expref: 23 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.789793:0:214434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549696:0@lo:104: 00000100:00100000:2.0:1789896038.789828:0:214434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896038.789835:0:189482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789896038.789844:0:189482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa724ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214434:x1876838003549312:12345-0@lo:104: Request processed in 103us (353us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896038.789845:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1789896038.789852:0:214434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a238a expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896038.789857:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214434:x1876838003549440:12345-0@lo:104: Request processed in 105us (265us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896038.789873:0:214434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a238a expref: 23 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896038.789877:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:0.0:1789896038.789901:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003549568 00000100:00100000:1.0:1789896038.789904:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003549696 00000100:00100000:0.0:1789896038.789907:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003549568 00000100:00100000:1.0:1789896038.789910:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003549696 00000100:00100000:3.0:1789896038.789924:0:189482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1789896038.789942:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1789896038.789950:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1789896038.789954:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214434:x1876838003549568:12345-0@lo:104: 00000100:00100000:1.0:1789896038.789964:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214434:x1876838003549696:12345-0@lo:104: 00010000:00010000:0.0:1789896038.789965:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a23ad expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.789976:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a239f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.790014:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:3.0:1789896038.790019:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:0.0:1789896038.790021:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214434:x1876838003549568:12345-0@lo:104: Request processed in 71us (308us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896038.790031:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789896038.790039:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214434:x1876838003549696:12345-0@lo:104: Request processed in 79us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896038.790066:0:214434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549824:0@lo:104: 00000100:00100000:2.0:1789896038.790090:0:214434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896038.790094:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a23d7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790105:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2200 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896038.790108:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a23d7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.790114:0:214434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a237c expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790120:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a23d7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896038.790135:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a23d7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.790142:0:214434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a237c expref: 23 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896038.790144:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789896038.790157:0:214434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549952:0@lo:104: 00010000:00010000:3.0:1789896038.790180:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23d7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.790184:0:214434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896038.790192:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896038.790237:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23d7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.790240:0:214434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a236e expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790255:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d2200/0x412fd4b3617a23d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23d7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.790259:0:214434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a236e expref: 23 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790273:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1789896038.790274:0:214434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003550208:0@lo:104: 00010000:00010000:3.0:1789896038.790281:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a23c9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.790298:0:214434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896038.790313:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2600 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:2.0:1789896038.790317:0:214434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2360 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896038.790319:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a23c9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790337:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a23c9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.790339:0:214434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2360 expref: 23 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896038.790362:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a23c9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896038.790368:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896038.790384:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23c9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896038.790386:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00010000:00010000:3.0:1789896038.790395:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896038.790397:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1789896038.790407:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003549824 00000100:00100000:0.0:1789896038.790412:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003549824 00010000:00010000:3.0:1789896038.790418:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23c9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896038.790419:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003549952 00000100:00100000:1.0:1789896038.790425:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003549952 00010000:00010000:3.0:1789896038.790430:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d2600/0x412fd4b3617a23c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23c9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896038.790431:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003550208 00000100:00100000:0.0:1789896038.790437:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003550208 00010000:00010000:3.0:1789896038.790447:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789896038.790452:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a23bb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896038.790452:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00010000:00010000:3.0:1789896038.790462:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3e00 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:1.0:1789896038.790466:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214434:x1876838003549824:12345-0@lo:104: 10000000:00010000:3.0:1789896038.790467:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a23bb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.790469:0:214434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003550336:0@lo:104: 00010000:00010000:1.0:1789896038.790483:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2391 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.790504:0:214434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789896038.790506:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a23bb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896038.790515:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a23bb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896038.790521:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896038.790531:0:214434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f608 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.790535:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1789896038.790541:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23bb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896038.790547:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214434:x1876838003549824:12345-0@lo:104: Request processed in 82us (453us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896038.790548:0:214434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f608 expref: 9 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790554:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896038.790565:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23bb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.790570:0:214434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003550592:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789896038.790576:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3e00/0x412fd4b3617a23b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23bb expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790593:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789896038.790597:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a23ad expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790604:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5be00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896038.790608:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a23ad expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790615:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a23ad expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896038.790622:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a23ad expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896038.790635:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896038.790637:0:214434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f601 expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.790648:0:214434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2352 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f601 expref: 9 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790653:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23ad expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.790658:0:214434:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003550848:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789896038.790673:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896038.790683:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23ad expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.790689:0:214434:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5009b9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789896038.790692:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5be00/0x412fd4b3617a23a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23ad expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790704:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789896038.790707:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a239f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.790713:0:214434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950b41c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549184:0@lo:104: 00010000:00010000:3.0:1789896038.790716:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2800 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:3.0:1789896038.790722:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a239f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.790728:0:214434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549312:0@lo:104: 00010000:00010000:3.0:1789896038.790732:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a239f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.790739:0:214434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549440:0@lo:104: 10000000:00010000:3.0:1789896038.790748:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a239f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.790752:0:214434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549568:0@lo:104: 10000000:01000000:3.0:1789896038.790761:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789896038.790764:0:214434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549696:0@lo:104: 00000100:00100000:2.0:1789896038.790773:0:214434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549824:0@lo:104: 00010000:00010000:3.0:1789896038.790777:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a239f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790785:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896038.790797:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a239f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790804:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d2800/0x412fd4b3617a2398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a239f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.790813:0:188715:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1789896038.790815:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789896038.790821:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2391 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.790826:0:188715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003550336 00010000:00010000:3.0:1789896038.790828:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2c00 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:2.0:1789896038.790831:0:188715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003550336 10000000:00010000:3.0:1789896038.790833:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2391 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790843:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2391 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896038.790848:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2391 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896038.790854:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896038.790868:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2391 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790874:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789896038.790879:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2391 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790885:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a238a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2391 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.790906:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896038.790907:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896038.790909:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896038.790922:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003550080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896038.790953:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896038.790971:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003551104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896038.791002:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896038.791021:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789896038.791027:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003550976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896038.791045:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896038.791086:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003550464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896038.791089:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:0.0:1789896038.791100:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1789896038.791113:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1789896038.791115:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214434:x1876838003549952:12345-0@lo:104: 00000100:00100000:3.0:1789896038.791122:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896038.791126:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00010000:00010000:0.0:1789896038.791127:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2383 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.791131:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214434:x1876838003550208:12345-0@lo:104: 00000100:00100000:1.0:1789896038.791143:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94db3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214434:x1876838003550336:12345-0@lo:104: 00000100:00100000:3.0:1789896038.791147:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003551232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896038.791147:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2375 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.791155:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2367 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.791176:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789896038.791182:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214434:x1876838003549952:12345-0@lo:104: Request processed in 70us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896038.791190:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:3.0:1789896038.791192:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896038.791223:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896038.791228:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2383 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.791235:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789896038.791236:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3600 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896038.791238:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:0.0:1789896038.791243:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2383 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.791245:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214434:x1876838003550208:12345-0@lo:104: Request processed in 119us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896038.791255:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94db3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214434:x1876838003550336:12345-0@lo:104: Request processed in 114us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896038.791260:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789896038.791263:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00010000:00010000:0.0:1789896038.791263:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2383 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896038.791272:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003550720:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1789896038.791276:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2383 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896038.791280:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 10000000:01000000:0.0:1789896038.791286:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896038.791304:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789896038.791305:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2383 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896038.791311:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896038.791313:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2375 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.791317:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896038.791329:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d3c00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896038.791329:0:188720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789896038.791329:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2383 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896038.791335:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:00010000:2.0:1789896038.791337:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2375 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.791339:0:188720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2367 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896038.791348:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003551360:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896038.791363:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2375 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.791364:0:188720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5b400 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:0.0:1789896038.791364:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3600/0x412fd4b3617a237c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2383 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896038.791372:0:188720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2367 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896038.791382:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789896038.791389:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2375 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.791389:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896038.791393:0:188720:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2367 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.791393:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896038.791398:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789896038.791403:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1789896038.791412:0:188720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2367 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896038.791418:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003550080 10000000:01000000:1.0:1789896038.791420:0:188720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789896038.791424:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003550080 00010000:00010000:2.0:1789896038.791435:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2375 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.791442:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896038.791445:0:188720:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2367 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.791449:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a23d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a23d0 expref: 24 pid: 188723 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.791457:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2375 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.791459:0:188720:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896038.791472:0:188720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2367 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.791473:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d3c00/0x412fd4b3617a236e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2375 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896038.791482:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003551104 00000100:00100000:0.0:1789896038.791488:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003551104 00010000:00010000:1.0:1789896038.791498:0:188720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5b400/0x412fd4b3617a2360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2367 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.791502:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896038.791504:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a239f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2398 expref: 25 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.791506:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896038.791507:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003550976 00010000:00010000:2.0:1789896038.791511:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896038.791514:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003550976 00010000:00010000:1.0:1789896038.791519:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789896038.791522:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789896038.791524:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896038.791525:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003550464 00000100:00100000:0.0:1789896038.791529:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003550464 00010000:00010000:1.0:1789896038.791531:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896038.791536:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a23ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a23a6 expref: 27 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.791546:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a23c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a23c2 expref: 27 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.791555:0:214434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003549952:0@lo:104: 00010000:00010000:1.0:1789896038.791556:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896038.791560:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003551232 00000100:00100000:0.0:1789896038.791565:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003551232 00000100:00100000:2.0:1789896038.791568:0:214434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003550208:0@lo:104: 00010000:00010000:0.0:1789896038.791577:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a238a expref: 28 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896038.791580:0:191756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003550720 00000100:00100000:1.0:1789896038.791587:0:191756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003550720 00000100:00100000:2.0:1789896038.791589:0:214434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f63480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003550336:0@lo:104: 00000100:00100000:0.0:1789896038.791597:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003551360 00000100:00100000:0.0:1789896038.791602:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003551360 00010000:00010000:1.0:1789896038.791610:0:191756:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a23bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a23b4 expref: 30 pid: 188723 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896038.791612:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00010000:00010000:0.0:1789896038.791618:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a237c expref: 30 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.791624:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003551488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896038.791627:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+30:3616:x1876838003550080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896038.791644:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896038.791647:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00010000:00010000:3.0:1789896038.791652:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a23d7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a23d0 expref: 30 pid: 188723 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896038.791657:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1789896038.791661:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+30:3616:x1876838003551104:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896038.791673:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896038.791673:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+30:3617:x1876838003550464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896038.791677:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a23d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a23d0 expref: 30 pid: 188723 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.791678:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896038.791687:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896038.791688:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a239f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2398 expref: 30 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.791691:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789896038.791699:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b200/0x412fd4b3617a23d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a23d0 expref: 30 pid: 188723 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.791702:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a23c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a23c2 expref: 30 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.791703:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003551616:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896038.791707:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a239f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2398 expref: 30 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.791728:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896038.791733:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a23c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a23c2 expref: 29 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.791735:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896038.791753:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a239f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2398 expref: 29 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.791758:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a23c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a23c2 expref: 29 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.791766:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003551488 00000100:00100000:3.0:1789896038.791770:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a50c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+27:3616:x1876838003550080:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (813us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896038.791770:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896038.791772:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003551488 00010000:00010000:0.0:1789896038.791773:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896038.791793:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a236e expref: 28 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896038.791812:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3616:x1876838003551104:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896038.791823:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3617:x1876838003550464:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896038.792077:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:1.0:1789896038.792085:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:2.0:1789896038.792090:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003551616 00000100:00100000:2.0:1789896038.792096:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003551616 00000100:00100000:0.0:1789896038.792096:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1789896038.792113:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00010000:00010000:2.0:1789896038.792116:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2360 expref: 26 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896038.792126:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1789896038.792127:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3617:x1876838003551232:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896038.792136:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00010000:00010000:1.0:1789896038.792139:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789896038.792141:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3616:x1876838003550976:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896038.792146:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00010000:00010000:1.0:1789896038.792148:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a238a expref: 26 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896038.792151:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3617:x1876838003550720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896038.792158:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896038.792163:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3617:x1876838003551360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896038.792167:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896038.792168:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a23ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a23a6 expref: 26 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.792171:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a238a expref: 26 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.792177:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896038.792177:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a23bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a23b4 expref: 26 pid: 188723 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.792187:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2383 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a237c expref: 26 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.792229:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a23ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a23a6 expref: 26 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.792247:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a23bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a23b4 expref: 26 pid: 188723 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.792262:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a238a expref: 26 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.792263:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a237c expref: 26 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.792290:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a23ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a23a6 expref: 25 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.792296:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a23bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a23b4 expref: 25 pid: 188723 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.792299:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896038.792301:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a2383 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a237c expref: 25 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896038.792307:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896038.792323:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896038.792324:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896038.792335:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b75c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3617:x1876838003551232:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896038.792343:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1789896038.792362:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1789896038.792367:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3617:x1876838003550720:12345-0@lo:103:ldlm_bl.0 Request processed in 219us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896038.792374:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3615:x1876838003551488:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896038.792375:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1789896038.792376:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:3617:x1876838003551360:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (996us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896038.792389:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896038.792390:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00010000:00010000:1.0:1789896038.792398:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2375 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a236e expref: 20 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896038.792398:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00010000:00010000:1.0:1789896038.792413:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2375 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a236e expref: 19 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896038.792418:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3615:x1876838003551616:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896038.792428:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:3616:x1876838003550976:12345-0@lo:103:ldlm_bl.0 Request processed in 289us (1377us total) trans 0 rc 0/0 00010000:00010000:0.0:1789896038.792434:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896038.792435:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8200/0x412fd4b3617a2375 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a236e expref: 19 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896038.792441:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00010000:00010000:0.0:1789896038.792442:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2360 expref: 19 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.792444:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003550976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896038.792463:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2360 expref: 17 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.792467:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003550080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896038.792471:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896038.792476:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a2367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2360 expref: 17 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.792481:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3616:1876838003551104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896038.792486:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896038.792518:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a53050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3615:x1876838003551488:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896038.792526:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3615:x1876838003551616:12345-0@lo:103:ldlm_bl.0 Request processed in 112us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896038.792529:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1789896038.792531:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003551360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896038.792541:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:2.0:1789896038.792551:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003550720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896038.792566:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003550464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896038.792585:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003551232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896038.792586:0:214434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003550592:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789896038.792613:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003551616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896038.792617:0:214434:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214434:1876838003550848:192.168.202.44@tcp:104: 00000100:00100000:1.0:1789896038.792631:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003551488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789896038.792684:0:214434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896038.792940:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896038.792959:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896038.792977:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896038.792997:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015956352 00000100:00100000:1.0:1789896038.793007:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015956352 00010000:00010000:1.0:1789896038.793024:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f608 expref: 10 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896038.793060:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015956608 00000100:00100000:1.0:1789896038.793064:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015956608 00010000:00010000:1.0:1789896038.793076:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2352 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f601 expref: 11 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896038.793099:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 504 00000100:00100000:1.0:1789896038.793106:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015956352:12345-192.168.202.44@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789896038.793111:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 505 00010000:00010000:1.0:1789896038.793115:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789896038.793120:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+11:2403:x1876838015956608:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789896038.793124:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f608 expref: 11 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.793129:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789896038.793137:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2352 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f601 expref: 11 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.793139:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f608 expref: 11 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.793143:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015956480 00000100:00100000:2.0:1789896038.793151:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015956480 00010000:00010000:0.0:1789896038.793164:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f601 expref: 12 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.793180:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a2359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f608 expref: 12 pid: 188726 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.793189:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a2352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f601 expref: 12 pid: 188725 timeout: 4011 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896038.793193:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2120 00010000:00010000:1.0:1789896038.793220:0:188716:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.793239:0:188716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.793246:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789896038.793252:0:188716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.793262:0:188716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.793277:0:188716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896038.793281:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a6f6720b-db77-464e-82b6-5f314c431303+10:2403:x1876838015956608:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 160us (299us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896038.793289:0:188716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896038.793296:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 505 00010000:00010000:1.0:1789896038.793304:0:188716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9400 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:1.0:1789896038.793309:0:188716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.793317:0:188716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.793332:0:188716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896038.793342:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896038.793365:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f6720b-db77-464e-82b6-5f314c431303+9:2403:x1876838015956352:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 259us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896038.793373:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 504 00000100:00100000:2.0:1789896038.793411:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015956480:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896038.793412:0:214434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896038.793421:0:214434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.793425:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896038.793426:0:214434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a23de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.793442:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a23e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f60f expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.793462:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a23e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f60f expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.793473:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a23e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f60f expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896038.793490:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9200, rc 0) 00000100:00100000:2.0:1789896038.793523:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015956480:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 118us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896038.793530:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2120 00000100:00100000:0.0:1789896038.794512:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896038.794551:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015956736 00000100:00100000:2.0:1789896038.794557:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015956736 00000100:00100000:2.0:1789896038.794587:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2121 00000100:00100000:2.0:1789896038.794594:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015956736:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896038.794666:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015956736:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 72us (154us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789896038.794674:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2121 00000100:00100000:3.0:1789896039.286788:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896039.286850:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896039.286891:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015956864 00000100:00100000:3.0:1789896039.286906:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896039.286908:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015956864 00000100:00100000:0.0:1789896039.286937:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015957120 00000100:00100000:0.0:1789896039.286944:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015957120 00000100:00100000:2.0:1789896039.286984:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2122 00000100:00100000:1.0:1789896039.286990:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015956992 00000100:00100000:2.0:1789896039.286998:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:2401:x1876838015956864:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:1.0:1789896039.287001:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015956992 00000100:00100000:0.0:1789896039.287010:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 505 00000100:00100000:0.0:1789896039.287022:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2401:x1876838015957120:12345-192.168.202.44@tcp:400:kworker.0 00000100:00080000:3.0:1789896039.287042:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789896039.287063:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 506 00000100:00100000:1.0:1789896039.287072:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2401:x1876838015956992:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789896039.287109:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:2401:x1876838015956864:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 113us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896039.287111:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2401:x1876838015956992:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 37us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896039.287114:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2401:x1876838015957120:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 91us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896039.287133:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2122 00000100:00100000:1.0:1789896039.287133:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 506 00000100:00100000:0.0:1789896039.287145:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 505 00010000:00010000:0.0:1789896039.404469:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896039.852524:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003552128:0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.852546:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003551744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789896039.852604:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896039.852605:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896039.852642:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003552640:0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.852649:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003552384:0@lo:400:kworker.0 00000100:00100000:2.0:1789896039.852672:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896039.852689:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896039.852705:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876838003553152:0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.852716:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003552896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789896039.852744:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896039.852766:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876838003553408:0@lo:400:kworker.0 00000100:00100000:2.0:1789896039.852770:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896039.852799:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896039.852802:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1789896039.852811:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003552000:0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.852823:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1789896039.852841:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003551872:0@lo:400:kworker.0 00000100:00100000:2.0:1789896039.852844:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896039.852868:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003552512:0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.852889:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896039.852988:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003552384 00000100:00100000:0.0:1789896039.852995:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003552384 00000100:00100000:1.0:1789896039.853024:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003553152 00000100:00100000:1.0:1789896039.853033:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003553152 00000100:00100000:1.0:1789896039.853097:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003553408 00000100:00100000:1.0:1789896039.853100:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003553408 00000100:00100000:1.0:1789896039.853123:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1789896039.853131:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3616:x1876838003553152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896039.853270:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:0.0:1789896039.853276:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a95085bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876838003553408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896039.853682:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896039.853709:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003552256:0@lo:400:kworker.0 00000100:00100000:2.0:1789896039.853713:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876838003553024:0@lo:400:kworker.0 00000100:00100000:1.0:1789896039.853757:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+8:3616:x1876838003553152:12345-0@lo:400:kworker.0 Request processed in 623us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896039.853758:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896039.853770:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a95085bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876838003553408:12345-0@lo:400:kworker.0 Request processed in 491us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896039.853771:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1789896039.853786:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003552768:0@lo:400:kworker.0 00000100:00100000:0.0:1789896039.853789:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1789896039.853797:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1789896039.853809:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876838003552384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896039.853815:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896039.853822:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896039.853834:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003553024 00000100:00100000:0.0:1789896039.853839:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003553024 00000100:00100000:2.0:1789896039.853854:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876838003553536:0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.853860:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876838003553280:0@lo:400:kworker.0 00000100:00100000:1.0:1789896039.853863:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876838003552384:12345-0@lo:400:kworker.0 Request processed in 56us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896039.853881:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1789896039.853888:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896039.853892:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:0.0:1789896039.853894:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3616:x1876838003553024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.853909:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003551744 00000100:00100000:1.0:1789896039.853912:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003553536 00000100:00100000:3.0:1789896039.853914:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003551744 00000100:00100000:1.0:1789896039.853918:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003553536 00000100:00100000:2.0:1789896039.853942:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876838003553152:0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.853947:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003552896 00000100:00100000:0.0:1789896039.853947:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3616:x1876838003553024:12345-0@lo:400:kworker.0 Request processed in 55us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896039.853951:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003552896 00000100:00100000:1.0:1789896039.853958:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:0.0:1789896039.853966:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1789896039.853970:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003553664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789896039.853972:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876838003553536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.853979:0:190238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789896039.853988:0:190238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003551744:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789896039.854005:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1789896039.854012:0:190238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789896039.854015:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789896039.854022:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789896039.854029:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876838003553536:12345-0@lo:400:kworker.0 Request processed in 62us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896039.854037:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1789896039.854054:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876838003553024:0@lo:400:kworker.0 00000100:00100000:0.0:1789896039.854062:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003552000 00000100:00100000:0.0:1789896039.854068:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003552000 00000100:00100000:3.0:1789896039.854077:0:190238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003551744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (1474us total) trans 0 rc 0/0 00010000:00080000:2.0:1789896039.854077:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91aa77b74a80 x1876838003553536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789896039.854078:0:190237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003553664 00000100:00100000:1.0:1789896039.854086:0:190237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003553664 00000100:00100000:3.0:1789896039.854093:0:190238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789896039.854102:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003552512 00000100:00100000:2.0:1789896039.854103:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876838003553536:0@lo:400:kworker.0 00000100:00100000:0.0:1789896039.854109:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003552512 00000100:00100000:3.0:1789896039.854115:0:190238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789896039.854125:0:190238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003552896:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789896039.854135:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00002000:00000024:3.0:1789896039.854142:0:190238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789896039.854142:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1789896039.854143:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003552128 00000100:00100000:1.0:1789896039.854148:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003553664:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789896039.854149:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003552128 00002000:00000024:1.0:1789896039.854165:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789896039.854169:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003552000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.854176:0:190238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950859500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003552896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896039.854181:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003552640 00000100:00100000:3.0:1789896039.854186:0:190238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789896039.854186:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003552640 00000100:00100000:3.0:1789896039.854229:0:191519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003552256 00000100:00100000:3.0:1789896039.854233:0:191519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003552256 00000100:00100000:2.0:1789896039.854237:0:190233:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003552768 00000100:00100000:1.0:1789896039.854240:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003553664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896039.854243:0:190233:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003552768 00000100:00100000:3.0:1789896039.854258:0:191519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789896039.854260:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003552000:12345-0@lo:400:kworker.0 Request processed in 102us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896039.854266:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789896039.854278:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789896039.854279:0:191519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003552128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896039.854285:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00080000:1.0:1789896039.854293:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789896039.854298:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789896039.854299:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003552640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896039.854305:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1789896039.854321:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003552512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.854329:0:191519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1876838003552128:12345-0@lo:400:kworker.0 Request processed in 55us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896039.854331:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003553664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789896039.854339:0:191519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789896039.854353:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003552000:0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.854360:0:191519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789896039.854363:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947f63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003552640:12345-0@lo:400:kworker.0 Request processed in 65us (1688us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896039.854371:0:191519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003552256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896039.854375:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789896039.854376:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003552512:0@lo:400:kworker.0 00000100:00100000:0.0:1789896039.854379:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003552512:12345-0@lo:400:kworker.0 Request processed in 60us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896039.854391:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789896039.854400:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003552128:0@lo:400:kworker.0 00000100:00100000:2.0:1789896039.854404:0:190233:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789896039.854411:0:191519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1876838003552256:12345-0@lo:400:kworker.0 Request processed in 43us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896039.854417:0:190233:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003552768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.854420:0:191519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789896039.854420:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003552640:0@lo:400:kworker.0 00000100:00100000:0.0:1789896039.854465:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003551872 00000100:00100000:2.0:1789896039.854471:0:190233:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003552768:12345-0@lo:400:kworker.0 Request processed in 56us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896039.854471:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003551872 00000100:00100000:3.0:1789896039.854476:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896039.854485:0:190233:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789896039.854512:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:1.0:1789896039.854516:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003553280 00000100:00100000:3.0:1789896039.854519:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003551744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789896039.854522:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003553280 00000100:00100000:0.0:1789896039.854530:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3618:x1876838003551872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.854542:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003552384:0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.854563:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003552896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789896039.854568:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:0.0:1789896039.854580:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:3618:x1876838003551872:12345-0@lo:400:kworker.0 Request processed in 49us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896039.854581:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a950858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876838003553280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896039.854582:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876838003553408:0@lo:400:kworker.0 00000100:00100000:0.0:1789896039.854598:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00100000:3.0:1789896039.854629:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003551872:0@lo:400:kworker.0 00000100:00100000:1.0:1789896039.854634:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a950858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876838003553280:12345-0@lo:400:kworker.0 Request processed in 57us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896039.854642:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:3.0:1789896039.854646:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3618:1876838003552256:0@lo:400:kworker.0 00000100:00080000:0.0:1789896039.854646:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789896039.854658:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003552768:0@lo:400:kworker.0 00010000:00080000:3.0:1789896039.854667:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91aa77b76680 x1876838003553280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789896039.854675:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3618:1876838003553280:0@lo:400:kworker.0 00000100:00100000:0.0:1789896039.987614:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896039.987673:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015957248 00000100:00100000:2.0:1789896039.987682:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015957248 00000100:00100000:2.0:1789896039.987740:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2124 00000100:00100000:2.0:1789896039.987753:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015957248:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896039.987769:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896039.987785:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a23ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f616 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896039.987810:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a23ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f616 expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896039.987818:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a23ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f616 expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896039.987825:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8e00, rc 0) 00000100:00100000:2.0:1789896039.987883:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015957248:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 133us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896039.987891:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2124 00000100:00100000:3.0:1789896039.988766:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896039.988815:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015957376 00000100:00100000:0.0:1789896039.988821:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015957376 00000100:00100000:0.0:1789896039.988856:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2125 00000100:00100000:0.0:1789896039.988865:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015957376:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896039.988993:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015957376:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 130us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896039.989001:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2125 00000100:00100000:3.0:1789896039.989691:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896039.989745:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015957504 00000100:00100000:2.0:1789896039.989757:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015957504 00000100:00100000:2.0:1789896039.989786:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2126 00000100:00100000:2.0:1789896039.989794:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015957504:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896039.989883:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015957504:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 89us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896039.989891:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2126 00000100:00100000:2.0:1789896039.990999:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:0.0:1789896039.991064:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015957632 00000100:00100000:0.0:1789896039.991069:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015957632 00000100:00100000:0.0:1789896039.991097:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2127 00000100:00100000:0.0:1789896039.991102:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:213752:x1876838015957632:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789896039.991192:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:213752:x1876838015957632:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 88us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896039.991238:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2127 00000100:00100000:3.0:1789896039.991869:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896039.991910:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015957760 00000100:00100000:2.0:1789896039.991916:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015957760 00000100:00100000:2.0:1789896039.991942:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2128 00000100:00100000:2.0:1789896039.991949:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:213752:x1876838015957760:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896039.992036:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:213752:x1876838015957760:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 86us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896039.992056:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2128 10000000:01000000:2.0:1789896040.044318:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896040.044325:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 168 10000000:01000000:2.0:1789896040.044331:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896040.044381:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.044394:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.044405:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896040.044431:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003553792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.044518:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.044564:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.044594:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003553792 00000100:00100000:0.0:1789896040.044604:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003553792 00000100:00100000:0.0:1789896040.044663:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:0.0:1789896040.044673:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003553792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896040.044685:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896040.044704:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a23fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a23f3 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.044727:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a23fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a23f3 expref: 16 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.044738:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a23fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a23f3 expref: 16 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.044747:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5ae00, rc 0) 00000100:00100000:0.0:1789896040.044792:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003553792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.044799:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:2.0:1789896040.044837:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003553792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896040.044855:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23fa expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.044865:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a23fa expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896040.044922:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003553920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.044947:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.044979:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.044994:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003553920 00000100:00100000:0.0:1789896040.044999:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003553920 00000100:00100000:0.0:1789896040.045024:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2130 00000100:00100000:0.0:1789896040.045030:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003553920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.045144:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003553920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.045149:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2130 00000100:00100000:2.0:1789896040.045173:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003553920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.045221:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003554048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.045261:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.045286:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.045308:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003554048 00000100:00100000:0.0:1789896040.045313:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003554048 00000100:00100000:0.0:1789896040.045336:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:0.0:1789896040.045342:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003554048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.045418:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003554048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.045424:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:2.0:1789896040.045445:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003554048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.045680:0:214435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214435:1876838003554176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.045715:0:214435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.045732:0:214435:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d27f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.045753:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003554176 00000100:00100000:0.0:1789896040.045762:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003554176 00000100:00100000:0.0:1789896040.045788:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:0.0:1789896040.045796:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214435:x1876838003554176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896040.045880:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214435:x1876838003554176:12345-0@lo:502:llog_process_th.0 Request processed in 85us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.045887:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00100000:2.0:1789896040.045969:0:214435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214435:1876838003554176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.046025:0:214435:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214435:1876838003554304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.046072:0:214435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.046095:0:214435:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5c265300 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.046119:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003554304 00000100:00100000:0.0:1789896040.046124:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003554304 00000100:00100000:0.0:1789896040.046153:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:0.0:1789896040.046160:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214435:x1876838003554304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896040.046244:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214435:x1876838003554304:12345-0@lo:502:llog_process_th.0 Request processed in 84us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.046251:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00100000:2.0:1789896040.046265:0:214435:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214435:1876838003554304:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896040.046291:0:214435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 171 count 168 00000020:01000000:0.0:1789896040.046349:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 168-170 (rc=0) 10000000:01000000:0.0:1789896040.046379:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896040.046387:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23fa expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.046397:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a23fa expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896040.046405:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789896040.046407:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:0.0:1789896040.046410:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789896040.046426:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.046433:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.046446:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896040.046458:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003554432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.046483:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.046509:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003554432 00000100:00100000:0.0:1789896040.046512:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa74c7a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.046514:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003554432 00000100:00100000:2.0:1789896040.046547:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2134 00000100:00100000:2.0:1789896040.046555:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003554432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896040.046563:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896040.046573:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2401 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.046590:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2401 expref: 17 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.046599:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2401 expref: 17 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.046607:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8000, rc 0) 00000100:00100000:2.0:1789896040.046640:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003554432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.046647:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2134 00000100:00100000:0.0:1789896040.046677:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003554432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896040.046688:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2408 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.046696:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2408 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896040.046735:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003554560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.046758:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896040.046776:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa74c7a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.046782:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003554560 00000100:00100000:2.0:1789896040.046788:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003554560 00000100:00100000:2.0:1789896040.046814:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:2.0:1789896040.046820:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003554560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.046894:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003554560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.046903:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00100000:0.0:1789896040.046915:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003554560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.046942:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003554688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.046974:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.046997:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003554688 00000100:00100000:0.0:1789896040.046999:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa74c7a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.047002:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003554688 00000100:00100000:2.0:1789896040.047032:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:2.0:1789896040.047051:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003554688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.047121:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003554688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.047129:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:0.0:1789896040.047143:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003554688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789896040.047880:0:214436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:0.0:1789896040.047956:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:0.0:1789896040.047974:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789896040.047979:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2408 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.047991:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2408 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896040.047999:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896040.048001:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 168 10000000:01000000:0.0:1789896040.048003:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896040.048018:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.048025:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.048033:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896040.048057:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003554816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.048077:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896040.048096:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa74c7a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.048116:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003554816 00000100:00100000:2.0:1789896040.048120:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003554816 00000100:00100000:2.0:1789896040.048144:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:2.0:1789896040.048150:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003554816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896040.048158:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896040.048166:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2416 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a240f expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.048181:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a240f expref: 18 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.048190:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a240f expref: 18 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.048222:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8600, rc 0) 00000100:00100000:2.0:1789896040.048256:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003554816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.048260:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00000100:00100000:0.0:1789896040.048287:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003554816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896040.048302:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2416 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.048310:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2416 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896040.048337:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003554944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.048357:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.048388:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003554944 00000100:00100000:2.0:1789896040.048392:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003554944 00000100:00100000:0.0:1789896040.048400:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa74c7a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.048414:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2138 00000100:00100000:2.0:1789896040.048419:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003554944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.048475:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003554944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.048480:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2138 00000100:00100000:0.0:1789896040.048502:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003554944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.048525:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003555072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.048558:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.048575:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003555072 00000100:00100000:0.0:1789896040.048577:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa74c7a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.048579:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003555072 00000100:00100000:2.0:1789896040.048599:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1789896040.048602:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003555072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.048649:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003555072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 45us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.048655:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:0.0:1789896040.048674:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003555072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.048834:0:214437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214437:1876838003555200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896040.048866:0:214437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896040.048881:0:214437:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa74c7a240 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.048885:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003555200 00000100:00100000:2.0:1789896040.048889:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003555200 00000100:00100000:2.0:1789896040.048915:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:2.0:1789896040.048919:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214437:x1876838003555200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.048992:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214437:x1876838003555200:12345-0@lo:502:llog_process_th.0 Request processed in 71us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.049000:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00100000:0.0:1789896040.049011:0:214437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214437:1876838003555200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896040.049056:0:214437:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214437:1876838003555328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896040.049090:0:214437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896040.049106:0:214437:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa5c2769c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.049111:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003555328 00000100:00100000:2.0:1789896040.049117:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003555328 00000100:00100000:2.0:1789896040.049143:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:2.0:1789896040.049150:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214437:x1876838003555328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.049236:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214437:x1876838003555328:12345-0@lo:502:llog_process_th.0 Request processed in 86us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.049243:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00100000:0.0:1789896040.049260:0:214437:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214437:1876838003555328:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896040.049282:0:214437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 171 count 168 00000020:01000000:2.0:1789896040.049326:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 168-170 (rc=0) 10000000:01000000:2.0:1789896040.049350:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896040.049361:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2416 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.049369:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2416 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896040.049377:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789896040.049379:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:2.0:1789896040.049381:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789896040.049397:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.049405:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.049412:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896040.049424:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003555456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.049451:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896040.049475:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003555456 00000100:00100000:2.0:1789896040.049479:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa51549d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.049481:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003555456 00000100:00100000:0.0:1789896040.049508:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2142 00000100:00100000:0.0:1789896040.049514:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003555456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896040.049521:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896040.049528:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2424 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a241d expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.049541:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a241d expref: 19 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.049555:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a241d expref: 19 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.049562:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a000, rc 0) 00000100:00100000:0.0:1789896040.049590:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003555456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.049597:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2142 00000100:00100000:2.0:1789896040.049603:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003555456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896040.049613:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2424 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.049619:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2424 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896040.049645:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003555584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.049676:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.049693:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa51549d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.049696:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003555584 00000100:00100000:0.0:1789896040.049701:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003555584 00000100:00100000:0.0:1789896040.049725:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2143 00000100:00100000:0.0:1789896040.049731:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003555584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.049794:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003555584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.049801:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2143 00000100:00100000:2.0:1789896040.049804:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003555584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.049826:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003555712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.049851:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.049862:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa51549d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.049870:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003555712 00000100:00100000:0.0:1789896040.049874:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003555712 00000100:00100000:0.0:1789896040.049898:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2144 00000100:00100000:0.0:1789896040.049904:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003555712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.049972:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003555712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.049978:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003555712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.049982:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2144 00000040:00080000:0.0:1789896040.050518:0:214438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:2.0:1789896040.050557:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:2.0:1789896040.050569:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789896040.050573:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2424 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.050578:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2424 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896040.050583:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896040.050584:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 168 10000000:01000000:2.0:1789896040.050585:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896040.050595:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.050599:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.050604:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896040.050611:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003555840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.050635:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896040.050655:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003555840 00000100:00100000:2.0:1789896040.050658:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa51549d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.050659:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003555840 00000100:00100000:0.0:1789896040.050684:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2145 00000100:00100000:0.0:1789896040.050688:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003555840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896040.050698:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896040.050703:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a242b expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.050713:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a242b expref: 20 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.050718:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a242b expref: 20 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.050723:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b600, rc 0) 00000100:00100000:0.0:1789896040.050744:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003555840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 56us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.050748:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2145 00000100:00100000:2.0:1789896040.050765:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003555840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896040.050774:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2432 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.050779:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2432 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896040.050802:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003555968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.050821:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.050833:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa51549d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.050836:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003555968 00000100:00100000:0.0:1789896040.050839:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003555968 00000100:00100000:0.0:1789896040.050857:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2146 00000100:00100000:0.0:1789896040.050860:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003555968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.050905:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003555968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 44us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.050910:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2146 00000100:00100000:2.0:1789896040.050917:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003555968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.050935:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003556096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.050959:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.050970:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa51549d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.050978:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003556096 00000100:00100000:0.0:1789896040.050983:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003556096 00000100:00100000:0.0:1789896040.051013:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2147 00000100:00100000:0.0:1789896040.051019:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003556096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.051094:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003556096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.051110:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2147 00000100:00100000:2.0:1789896040.051118:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003556096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.051306:0:214439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214439:1876838003556224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896040.051343:0:214439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.051369:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003556224 00000100:00100000:0.0:1789896040.051372:0:214439:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa50343540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.051374:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003556224 00000100:00100000:2.0:1789896040.051403:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2148 00000100:00100000:2.0:1789896040.051411:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214439:x1876838003556224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.051483:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214439:x1876838003556224:12345-0@lo:502:llog_process_th.0 Request processed in 72us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.051492:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2148 00000100:00100000:0.0:1789896040.051499:0:214439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214439:1876838003556224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896040.051538:0:214439:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214439:1876838003556352:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896040.051569:0:214439:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896040.051588:0:214439:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a948db2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.051592:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003556352 00000100:00100000:2.0:1789896040.051603:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003556352 00000100:00100000:2.0:1789896040.051630:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2149 00000100:00100000:2.0:1789896040.051638:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214439:x1876838003556352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.051703:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214439:x1876838003556352:12345-0@lo:502:llog_process_th.0 Request processed in 66us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.051712:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2149 00000100:00100000:0.0:1789896040.051716:0:214439:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214439:1876838003556352:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896040.051739:0:214439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 171 count 168 00000020:01000000:2.0:1789896040.051775:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 168-170 (rc=0) 10000000:01000000:2.0:1789896040.051794:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896040.051801:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2432 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.051809:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2432 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896040.051817:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789896040.051819:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 194 10000000:01000000:2.0:1789896040.051821:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789896040.051834:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.051847:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.051855:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896040.051868:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003556480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.051893:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.051911:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa51549f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.051916:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003556480 00000100:00100000:0.0:1789896040.051922:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003556480 00000100:00100000:0.0:1789896040.051948:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2150 00000100:00100000:0.0:1789896040.051954:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003556480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896040.051961:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896040.051969:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2440 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2439 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.051983:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2439 expref: 21 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.051991:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2439 expref: 21 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.051999:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5b000, rc 0) 00000100:00100000:0.0:1789896040.052048:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003556480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.052055:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2150 00000100:00100000:2.0:1789896040.052065:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003556480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896040.052080:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2440 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.052089:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a2440 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896040.052123:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003556608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.052149:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.052165:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa51549f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.052171:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003556608 00000100:00100000:0.0:1789896040.052175:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003556608 00000100:00100000:0.0:1789896040.052229:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2151 00000100:00100000:0.0:1789896040.052237:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003556608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.052297:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003556608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.052304:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2151 00000100:00100000:2.0:1789896040.052315:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003556608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.052340:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003556736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.052373:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896040.052397:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003556736 00000100:00100000:2.0:1789896040.052400:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa51549f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.052401:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003556736 00000100:00100000:0.0:1789896040.052424:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2152 00000100:00100000:0.0:1789896040.052428:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003556736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.052476:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003556736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 47us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.052481:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2152 00000100:00100000:2.0:1789896040.052495:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003556736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.052657:0:214440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214440:1876838003556864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896040.052681:0:214440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896040.052693:0:214440:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d456c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.052702:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003556864 00000100:00100000:2.0:1789896040.052708:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003556864 00000100:00100000:2.0:1789896040.052734:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2153 00000100:00100000:2.0:1789896040.052741:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214440:x1876838003556864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.052828:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214440:x1876838003556864:12345-0@lo:502:llog_process_th.0 Request processed in 86us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.052835:0:214440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214440:1876838003556864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.052837:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2153 00000020:01000000:0.0:1789896040.052854:0:214440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789896040.052863:0:214440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896040.052865:0:214440:0:(obd_config.c:1561:class_process_config()) marker 184 (0x1) lustre-MDT0001-m new lustre.qpool2 00000020:00000080:0.0:1789896040.052869:0:214440:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:0.0:1789896040.052911:0:214440:0:(lod_pool.c:475:lod_pool_new()) qpool2 is pool #2 00000100:00100000:0.0:1789896040.052923:0:214440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214440:1876838003556992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896040.052947:0:214440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896040.052959:0:214440:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a947d456c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.052969:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003556992 00000100:00100000:2.0:1789896040.052975:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003556992 00000100:00100000:2.0:1789896040.052999:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2154 00000100:00100000:2.0:1789896040.053006:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214440:x1876838003556992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.053107:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214440:x1876838003556992:12345-0@lo:502:llog_process_th.0 Request processed in 100us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.053114:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2154 00000100:00100000:0.0:1789896040.053118:0:214440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214440:1876838003556992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789896040.053137:0:214440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789896040.053140:0:214440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789896040.053141:0:214440:0:(obd_config.c:1561:class_process_config()) marker 184 (0x2) lustre-MDT0001-m new lustre.qpool2 00000040:00080000:0.0:1789896040.053143:0:214440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 197 count 193 00000020:01000000:2.0:1789896040.053175:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 194-196 (rc=0) 10000000:01000000:2.0:1789896040.053195:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789896040.053227:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2440 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.053237:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a2440 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896040.053246:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789896040.053247:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 168 10000000:01000000:2.0:1789896040.053250:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789896040.053263:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.053271:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.053278:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896040.053291:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003557120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.053314:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896040.053342:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003557120 00000100:00100000:2.0:1789896040.053344:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94d3020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.053347:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003557120 00000100:00100000:0.0:1789896040.053377:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2155 00000100:00100000:0.0:1789896040.053385:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003557120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896040.053392:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896040.053400:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a244e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2447 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.053415:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a244e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2447 expref: 22 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.053424:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a244e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2447 expref: 22 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.053430:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a400, rc 0) 00000100:00100000:0.0:1789896040.053465:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003557120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.053473:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2155 00000100:00100000:3.0:1789896040.053483:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003557120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896040.053497:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a244e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896040.053506:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a244e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896040.053548:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003557248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896040.053575:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896040.053591:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45337600 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.053596:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003557248 00000100:00100000:2.0:1789896040.053602:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003557248 00000100:00100000:2.0:1789896040.053630:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2156 00000100:00100000:2.0:1789896040.053644:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003557248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.053718:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003557248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896040.053725:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003557248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.053726:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2156 00000100:00100000:3.0:1789896040.053762:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003557376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896040.053793:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896040.053808:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45337600 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.053821:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003557376 00000100:00100000:0.0:1789896040.053825:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003557376 00000100:00100000:0.0:1789896040.053852:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2157 00000100:00100000:0.0:1789896040.053867:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003557376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.053921:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003557376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.053927:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2157 00000100:00100000:3.0:1789896040.053934:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003557376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.054147:0:214441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214441:1876838003557504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896040.054180:0:214441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896040.054216:0:214441:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa50343540 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.054241:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003557504 00000100:00100000:2.0:1789896040.054246:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003557504 00000100:00100000:2.0:1789896040.054273:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2158 00000100:00100000:2.0:1789896040.054282:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214441:x1876838003557504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.054359:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214441:x1876838003557504:12345-0@lo:502:llog_process_th.0 Request processed in 78us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.054367:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2158 00000100:00100000:0.0:1789896040.054381:0:214441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214441:1876838003557504:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896040.054421:0:214441:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214441:1876838003557632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896040.054450:0:214441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.054474:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003557632 00000100:00100000:0.0:1789896040.054478:0:214441:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe10b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.054479:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003557632 00000100:00100000:2.0:1789896040.054509:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2159 00000100:00100000:2.0:1789896040.054515:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214441:x1876838003557632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.054577:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214441:x1876838003557632:12345-0@lo:502:llog_process_th.0 Request processed in 61us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.054585:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2159 00000100:00100000:0.0:1789896040.054592:0:214441:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214441:1876838003557632:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896040.054617:0:214441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 171 count 168 00000020:01000000:3.0:1789896040.054687:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 168-170 (rc=0) 10000000:01000000:3.0:1789896040.054707:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789896040.054711:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a244e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896040.054717:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a244e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896040.054722:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789896040.054729:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 194 10000000:01000000:3.0:1789896040.054730:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789896040.054741:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896040.054746:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896040.054750:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896040.054758:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003557760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789896040.054777:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896040.054795:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe11f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.054814:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003557760 00000100:00100000:2.0:1789896040.054819:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003557760 00000100:00100000:2.0:1789896040.054847:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2160 00000100:00100000:2.0:1789896040.054854:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003557760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896040.054861:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896040.054870:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a245c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2455 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.054896:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a245c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2455 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.054906:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a245c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2455 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.054912:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8400, rc 0) 00000100:00100000:2.0:1789896040.054943:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003557760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.054950:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2160 00000100:00100000:3.0:1789896040.054959:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003557760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789896040.054971:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a245c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896040.054977:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a245c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896040.055004:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003557888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896040.055020:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896040.055032:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe11f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.055053:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003557888 00000100:00100000:2.0:1789896040.055058:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003557888 00000100:00100000:2.0:1789896040.055082:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2161 00000100:00100000:2.0:1789896040.055090:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003557888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.055157:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003557888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.055165:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2161 00000100:00100000:3.0:1789896040.055169:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003557888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789896040.055191:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003558016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789896040.055231:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896040.055254:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe11f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.055256:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003558016 00000100:00100000:2.0:1789896040.055261:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003558016 00000100:00100000:2.0:1789896040.055289:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2162 00000100:00100000:2.0:1789896040.055297:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003558016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.055364:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003558016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896040.055370:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003558016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.055374:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2162 00000100:00100000:3.0:1789896040.055544:0:214442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214442:1876838003558144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896040.055567:0:214442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896040.055578:0:214442:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa6fe11f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.055587:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003558144 00000100:00100000:2.0:1789896040.055592:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003558144 00000100:00100000:2.0:1789896040.055627:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2163 00000100:00100000:2.0:1789896040.055634:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214442:x1876838003558144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.055718:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214442:x1876838003558144:12345-0@lo:502:llog_process_th.0 Request processed in 84us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896040.055723:0:214442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214442:1876838003558144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.055728:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2163 00000020:01000000:3.0:1789896040.055739:0:214442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789896040.055746:0:214442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789896040.055747:0:214442:0:(obd_config.c:1561:class_process_config()) marker 183 (0x1) lustre-MDT0000-m new lustre.qpool2 00000020:00000080:3.0:1789896040.055752:0:214442:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1789896040.055784:0:214442:0:(lod_pool.c:475:lod_pool_new()) qpool2 is pool #2 00080000:10000000:3.0:1789896040.056291:0:214442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x58:0x0] (8/32) registered 00080000:10000000:3.0:1789896040.057457:0:214442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x59:0x0] (8/32) registered 00080000:10000000:3.0:1789896040.058304:0:214442:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x5a:0x0] (8/32) registered 00000100:00100000:3.0:1789896040.058868:0:214442:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214442:1876838003558272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789896040.058912:0:214442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896040.058939:0:214442:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94b592d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896040.058951:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003558272 00000100:00100000:2.0:1789896040.058958:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003558272 00000100:00100000:2.0:1789896040.058990:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2164 00000100:00100000:2.0:1789896040.058999:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214442:x1876838003558272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896040.059082:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214442:x1876838003558272:12345-0@lo:502:llog_process_th.0 Request processed in 85us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896040.059090:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2164 00000100:00100000:3.0:1789896040.059112:0:214442:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214442:1876838003558272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789896040.059137:0:214442:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789896040.059142:0:214442:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789896040.059143:0:214442:0:(obd_config.c:1561:class_process_config()) marker 183 (0x2) lustre-MDT0000-m new lustre.qpool2 00000040:00080000:3.0:1789896040.059147:0:214442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 197 count 193 00000020:01000000:2.0:1789896040.059229:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 194-196 (rc=0) 10000000:01000000:2.0:1789896040.059256:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789896040.059273:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a245c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.059286:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a245c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896040.059293:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789896040.059295:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:2.0:1789896040.059297:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789896040.059315:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.059323:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.059341:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896040.059353:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003558400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.059379:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.059406:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94d3020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.059408:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003558400 00000100:00100000:0.0:1789896040.059413:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003558400 00000100:00100000:0.0:1789896040.059435:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2165 00000100:00100000:0.0:1789896040.059440:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003558400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896040.059445:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896040.059454:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a246a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2463 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.059467:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a246a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2463 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.059473:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a246a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2463 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896040.059484:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5a200, rc 0) 00000100:00100000:0.0:1789896040.059509:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003558400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.059513:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2165 00000100:00100000:2.0:1789896040.059537:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003558400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896040.059548:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a246a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.059556:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a246a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896040.059595:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003558528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896040.059619:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896040.059636:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94d3020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896040.059637:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003558528 00000100:00100000:0.0:1789896040.059642:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003558528 00000100:00100000:0.0:1789896040.059660:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2166 00000100:00100000:0.0:1789896040.059663:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003558528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896040.059702:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003558528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 38us (83us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789896040.059706:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2166 00000100:00100000:2.0:1789896040.059723:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003558528:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789896040.059748:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789896040.059754:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a246a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.059763:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a246a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896040.428416:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896040.876313:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003558656:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789896040.876389:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896040.876415:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003558656 00000100:00100000:0.0:1789896040.876422:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003558656 00000100:00100000:0.0:1789896040.876470:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789896040.876477:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003558656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789896040.876507:0:192489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789896040.876562:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003558656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896040.876567:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1789896040.876601:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003558656:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789896041.452309:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789896041.457965:0:214540:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd55a080d0 20000000:00000080:2.0:1789896041.457980:0:214540:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff91a9478b2000 uarg=0000000000000000 00000040:00100000:2.0:1789896041.458610:0:214540:0:(llog.c:1072:llog_reverse_process()) index 170 : idx 137 20000000:01000000:2.0:1789896041.458616:0:214540:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 169 cmd:0xce020 lustre.qpool2 00000040:00080000:2.0:1789896041.458701:0:214540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].171, 224 off39432 20000000:01000000:2.0:1789896041.458720:0:214540:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789896041.458737:0:214540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].172, 128 off39560 00000040:00080000:2.0:1789896041.458754:0:214540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].173, 224 off39784 00000040:00080000:2.0:1789896041.458807:0:214540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].197, 224 off44232 20000000:01000000:2.0:1789896041.458815:0:214540:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789896041.458828:0:214540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].198, 136 off44368 00000040:00080000:2.0:1789896041.458841:0:214540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].199, 224 off44592 00000040:00080000:2.0:1789896041.458911:0:214540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].197, 224 off44232 20000000:01000000:2.0:1789896041.458920:0:214540:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:2.0:1789896041.458936:0:214540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].198, 136 off44368 00000040:00080000:2.0:1789896041.458954:0:214540:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].199, 224 off44592 10000000:01000000:2.0:1789896041.458965:0:214540:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789896041.458985:0:214540:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459005:0:214540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a23e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f60f expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459013:0:214540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a23ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f616 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459035:0:214540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a23fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a23f3 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459050:0:214540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2401 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459057:0:214540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a240f expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459064:0:214540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a241d expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459070:0:214540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a242b expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459077:0:214540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2440 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2439 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459084:0:214540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a244e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2447 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459090:0:214540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a245c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2455 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459097:0:214540:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a246a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2463 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459105:0:214540:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459145:0:214540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a246a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2463 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459169:0:214540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a246a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2463 expref: 23 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.459184:0:214540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003558784:0@lo:104: 00000100:00100000:2.0:1789896041.459269:0:214540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896041.459322:0:214540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a245c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2455 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.459328:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003558784 00010000:00010000:2.0:1789896041.459332:0:214540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a245c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2455 expref: 23 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.459338:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003558784 00000100:00100000:2.0:1789896041.459346:0:214540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003558912:0@lo:104: 00000100:00100000:2.0:1789896041.459373:0:214540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896041.459400:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003558912 00000100:00100000:0.0:1789896041.459405:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003558912 00010000:00010000:2.0:1789896041.459413:0:214540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a244e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2447 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896041.459420:0:188715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00010000:00010000:2.0:1789896041.459428:0:214540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a244e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2447 expref: 23 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896041.459436:0:188715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214540:x1876838003558784:12345-0@lo:104: 00000100:00100000:2.0:1789896041.459444:0:214540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003559040:0@lo:104: 00000100:00100000:1.0:1789896041.459445:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00010000:00010000:3.0:1789896041.459450:0:188715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a246a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896041.459459:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94d7bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214540:x1876838003558912:12345-0@lo:104: 00010000:00010000:1.0:1789896041.459467:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a245c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.459480:0:214540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896041.459523:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003559040 00000100:00100000:0.0:1789896041.459528:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003559040 00010000:00010000:2.0:1789896041.459530:0:214540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2439 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459542:0:214540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2439 expref: 23 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.459552:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789896041.459553:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:2.0:1789896041.459554:0:214540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003559168:0@lo:104: 00010000:00010000:3.0:1789896041.459563:0:188715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789896041.459564:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214540:x1876838003558912:12345-0@lo:104: Request processed in 107us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896041.459567:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214540:x1876838003559040:12345-0@lo:104: 00000100:00100000:3.0:1789896041.459574:0:188715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94d7bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+5:214540:x1876838003558784:12345-0@lo:104: Request processed in 142us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896041.459580:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00010000:00010000:0.0:1789896041.459585:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a244e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896041.459596:0:188715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1789896041.459598:0:214540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896041.459613:0:188714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003559168 00000100:00100000:1.0:1789896041.459619:0:188714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003559168 00010000:00010000:2.0:1789896041.459626:0:214540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a242b expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.459637:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789896041.459637:0:214540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a242b expref: 23 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.459646:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a245c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.459651:0:214540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003559296:0@lo:104: 00010000:00010000:0.0:1789896041.459658:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1789896041.459661:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a9512d2c00 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:1.0:1789896041.459661:0:188714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 10000000:00010000:3.0:1789896041.459666:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a245c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.459666:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b76680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214540:x1876838003559040:12345-0@lo:104: Request processed in 102us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896041.459675:0:188714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214540:x1876838003559168:12345-0@lo:104: 00000100:00100000:0.0:1789896041.459676:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00010000:00010000:3.0:1789896041.459679:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a245c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.459685:0:214540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789896041.459691:0:188714:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2440 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896041.459694:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a245c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.459694:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003559296 00000100:00100000:0.0:1789896041.459699:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003559296 00010000:00010000:2.0:1789896041.459709:0:214540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a241d expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896041.459710:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789896041.459724:0:214540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a241d expref: 23 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.459725:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:0.0:1789896041.459736:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214540:x1876838003559296:12345-0@lo:104: 00000100:00100000:2.0:1789896041.459742:0:214540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003559424:0@lo:104: 00010000:00010000:0.0:1789896041.459746:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2432 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.459750:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a245c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.459755:0:188714:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1789896041.459756:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896041.459767:0:188714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214540:x1876838003559168:12345-0@lo:104: Request processed in 93us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896041.459775:0:188714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00010000:00010000:3.0:1789896041.459790:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a245c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896041.459794:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1789896041.459799:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:2.0:1789896041.459800:0:214540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896041.459806:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:214540:x1876838003559296:12345-0@lo:104: Request processed in 69us (122us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896041.459807:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a9512d2c00/0x412fd4b3617a2455 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a245c expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.459807:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a246a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.459820:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00010000:00010000:1.0:1789896041.459823:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9c00 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896041.459828:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a246a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459833:0:214540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a240f expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.459836:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003559424 00000100:00100000:0.0:1789896041.459841:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003559424 00010000:00010000:1.0:1789896041.459844:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a246a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.459847:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789896041.459854:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a244e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.459855:0:214540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2416 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a240f expref: 23 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.459861:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 10000000:00010000:1.0:1789896041.459874:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a246a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.459874:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:214540:x1876838003559424:12345-0@lo:104: 00010000:00010000:3.0:1789896041.459875:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8a00 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:2.0:1789896041.459880:0:214540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003559680:0@lo:104: 10000000:00010000:3.0:1789896041.459882:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a244e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896041.459887:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2424 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896041.459892:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896041.459898:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a244e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896041.459905:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a244e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.459914:0:214540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789896041.459916:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896041.459920:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a246a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.459939:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a244e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.459940:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896041.459941:0:214540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a2401 expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896041.459944:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789896041.459956:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:214540:x1876838003559424:12345-0@lo:104: Request processed in 83us (158us total) trans 0 rc 0/0 00010000:00010000:3.0:1789896041.459959:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789896041.459962:0:214540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a2401 expref: 23 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.459970:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a246a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.459971:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a244e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.459981:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00010000:00010000:3.0:1789896041.459991:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8a00/0x412fd4b3617a2447 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a244e expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.459994:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9c00/0x412fd4b3617a2463 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a246a expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.460009:0:200085:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789896041.460013:0:214540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b75c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003560064:0@lo:104: 00010000:00010000:3.0:1789896041.460018:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789896041.460034:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2440 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.460035:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789896041.460036:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003559680 00000100:00100000:0.0:1789896041.460040:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003559680 00010000:00010000:1.0:1789896041.460043:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2432 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.460054:0:214540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896041.460061:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 462 00010000:00010000:1.0:1789896041.460062:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9600 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:3.0:1789896041.460065:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9800 already unused, calling callback (ffffffffc1214c20) 10000000:00010000:1.0:1789896041.460069:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2432 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896041.460070:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2440 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.460070:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a9478b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:214540:x1876838003559680:12345-0@lo:104: 00010000:00010000:2.0:1789896041.460078:0:214540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a23fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x412fd4b3617a23f3 expref: 23 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896041.460082:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2416 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.460090:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2440 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.460092:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2432 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.460103:0:214540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a23fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x412fd4b3617a23f3 expref: 23 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896041.460109:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2440 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789896041.460115:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2432 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896041.460131:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896041.460131:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789896041.460133:0:214540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b74a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003560192:0@lo:104: 10000000:01000000:1.0:1789896041.460134:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896041.460140:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a9478b3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:214540:x1876838003559680:12345-0@lo:104: Request processed in 69us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896041.460149:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 462 00010000:00010000:3.0:1789896041.460150:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2440 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.460156:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789896041.460163:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2432 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.460164:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2440 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.460175:0:214540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896041.460181:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003560064 00010000:00010000:3.0:1789896041.460185:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9800/0x412fd4b3617a2439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2440 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.460185:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789896041.460186:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003560064 00010000:00010000:1.0:1789896041.460196:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2432 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.460220:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789896041.460226:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2424 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.460226:0:214540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a23ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f616 expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.460231:0:200085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003560192 00010000:00010000:1.0:1789896041.460234:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9600/0x412fd4b3617a242b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2432 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.460235:0:200085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003560192 00010000:00010000:3.0:1789896041.460247:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9400 already unused, calling callback (ffffffffc1214c20) 00000100:00100000:0.0:1789896041.460251:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 10000000:00010000:3.0:1789896041.460254:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2424 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.460255:0:214540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a23ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f616 expref: 9 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.460261:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214540:x1876838003560064:12345-0@lo:104: 00010000:00010000:0.0:1789896041.460275:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2408 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.460285:0:214540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b77100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003560576:192.168.202.44@tcp:104: 00010000:00010000:1.0:1789896041.460287:0:190258:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789896041.460290:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2424 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.460294:0:190258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2416 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789896041.460306:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2424 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.460309:0:190258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5aa00 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:0.0:1789896041.460309:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1789896041.460316:0:190258:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2416 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789896041.460317:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789896041.460317:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+4:214540:x1876838003560064:12345-0@lo:104: Request processed in 58us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896041.460330:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00010000:00010000:1.0:1789896041.460334:0:190258:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2416 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.460335:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2424 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.460348:0:200085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00010000:00010000:3.0:1789896041.460351:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1789896041.460355:0:190258:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2416 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.460356:0:200085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:214540:x1876838003560192:12345-0@lo:104: 00010000:00010000:3.0:1789896041.460358:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2424 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.460361:0:214540:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a23e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f60f expref: 9 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789896041.460376:0:190258:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789896041.460376:0:200085:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a23fa expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.460379:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e9400/0x412fd4b3617a241d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2424 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.460383:0:214540:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a23e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f60f expref: 9 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.460394:0:205054:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789896041.460398:0:214540:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003560832:192.168.202.44@tcp:104: 00010000:00010000:3.0:1789896041.460400:0:205054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a2408 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.460402:0:190258:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2416 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.460416:0:205054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91a948c5a600 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896041.460418:0:190258:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896041.460420:0:214540:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94d302600 going to sleep for 11 seconds 10000000:00010000:3.0:1789896041.460421:0:205054:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a2408 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896041.460425:0:200085:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1789896041.460428:0:190258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2416 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.460431:0:205054:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a2408 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.460433:0:200085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+3:214540:x1876838003560192:12345-0@lo:104: Request processed in 76us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896041.460444:0:214540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003558784:0@lo:104: 00000100:00100000:0.0:1789896041.460446:0:200085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 10000000:00010000:3.0:1789896041.460449:0:205054:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a2408 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.460451:0:190258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5aa00/0x412fd4b3617a240f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2416 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.460460:0:214540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003558912:0@lo:104: 00010000:00010000:0.0:1789896041.460469:0:188719:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1789896041.460473:0:205054:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789896041.460476:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896041.460477:0:188719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x412fd4b3617a23fa expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.460481:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896041.460484:0:214540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003559040:0@lo:104: 00010000:00010000:0.0:1789896041.460487:0:188719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e8200 already unused, calling callback (ffffffffc1214c20) 00010000:00010000:1.0:1789896041.460488:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896041.460492:0:205054:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2408 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.460494:0:214540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003559168:0@lo:104: 10000000:00010000:0.0:1789896041.460494:0:188719:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x412fd4b3617a23fa expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.460506:0:205054:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789896041.460506:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003559808:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896041.460507:0:188719:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x412fd4b3617a23fa expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.460510:0:214540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003559296:0@lo:104: 00010000:00010000:3.0:1789896041.460513:0:205054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2408 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789896041.460523:0:188719:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x412fd4b3617a23fa expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.460526:0:205054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a2401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a2408 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.460531:0:214540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003559424:0@lo:104: 10000000:01000000:0.0:1789896041.460531:0:188719:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789896041.460537:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896041.460541:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789896041.460544:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896041.460550:0:214540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003559680:0@lo:104: 00010000:00010000:3.0:1789896041.460551:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896041.460551:0:188719:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23fa expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896041.460561:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896041.460564:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a950859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003559552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896041.460564:0:188719:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789896041.460567:0:214540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b75c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003560064:0@lo:104: 00010000:00010000:0.0:1789896041.460573:0:188719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23fa expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.460581:0:214540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b74a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003560192:0@lo:104: 00010000:00010000:0.0:1789896041.460581:0:188719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.144@tcp lock: ffff91aa654e8200/0x412fd4b3617a23f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x412fd4b3617a23fa expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896041.460592:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003560704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896041.460601:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896041.460603:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896041.460606:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789896041.460608:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789896041.460609:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003560320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896041.460616:0:192928:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789896041.460629:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003560448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896041.460634:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896041.460662:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896041.460684:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789896041.460688:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003559808 00000100:00100000:3.0:1789896041.460691:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003561216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896041.460693:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003559808 00000100:00100000:1.0:1789896041.460696:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003559936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896041.460713:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a246a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2463 expref: 24 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896041.460720:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896041.460751:0:199629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003559552 00000100:00100000:0.0:1789896041.460751:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003560704 00000100:00100000:1.0:1789896041.460758:0:199629:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003559552 00000100:00100000:0.0:1789896041.460758:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003560704 00000100:00100000:2.0:1789896041.460766:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003560448 00000100:00100000:3.0:1789896041.460771:0:188718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003561216 00000100:00100000:2.0:1789896041.460771:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003560448 00000100:00100000:3.0:1789896041.460778:0:188718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003561216 00010000:00010000:1.0:1789896041.460788:0:199629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a245c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2455 expref: 28 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896041.460788:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a241d expref: 28 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.460789:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a242b expref: 28 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.460823:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:0.0:1789896041.460829:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1789896041.460831:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3615:x1876838003559808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896041.460842:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896041.460843:0:188718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a23fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a23f3 expref: 28 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.460843:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3618:x1876838003560448:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896041.460844:0:199629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00010000:00010000:2.0:1789896041.460848:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a246a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2463 expref: 28 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896041.460858:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896041.460861:0:199629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3615:x1876838003560704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896041.460867:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a242b expref: 28 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.460869:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a246a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2463 expref: 28 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.460876:0:199629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789896041.460878:0:188718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00010000:00010000:1.0:1789896041.460887:0:199629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2424 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a241d expref: 28 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896041.460892:0:188718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+28:3618:x1876838003559552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896041.460893:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a200/0x412fd4b3617a246a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2463 expref: 28 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896041.460895:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a242b expref: 28 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.460911:0:188718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789896041.460916:0:188718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a245c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2455 expref: 27 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.460919:0:199629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a241d expref: 27 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.460937:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896041.460938:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b600/0x412fd4b3617a2432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a242b expref: 27 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.460940:0:188718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a245c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2455 expref: 27 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.460959:0:199629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a000/0x412fd4b3617a2424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a241d expref: 26 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896041.460960:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896041.460962:0:188718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a245c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2455 expref: 26 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.460971:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+26:3615:x1876838003559808:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (412us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896041.460984:0:199629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896041.460985:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00010000:00010000:3.0:1789896041.460993:0:188718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896041.460998:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ffbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3618:x1876838003560448:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896041.461008:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1789896041.461020:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:2.0:1789896041.461034:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3618:x1876838003561216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789896041.461044:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789896041.461046:0:199629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:3615:x1876838003560704:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896041.461049:0:188718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:3618:x1876838003559552:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (447us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896041.461051:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a23fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a23f3 expref: 22 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896041.461066:0:199629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00010000:00010000:2.0:1789896041.461070:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a23fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a23f3 expref: 22 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896041.461076:0:188718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:0.0:1789896041.461082:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789896041.461089:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5ae00/0x412fd4b3617a23fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a23f3 expref: 20 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.461100:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896041.461101:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003560320 00000100:00100000:1.0:1789896041.461106:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003560320 00000100:00100000:0.0:1789896041.461107:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003561088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896041.461128:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a950859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003559552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896041.461132:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3618:x1876838003561216:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (410us total) trans 0 rc 0/0 00010000:00010000:1.0:1789896041.461134:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2439 expref: 20 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896041.461145:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003560448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896041.461148:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1789896041.461149:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896041.461169:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003561088 00000100:00100000:2.0:1789896041.461172:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003561088 00000100:00100000:3.0:1789896041.461176:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003561216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896041.461184:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00010000:00010000:2.0:1789896041.461186:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2401 expref: 20 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896041.461231:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3617:x1876838003560320:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896041.461232:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896041.461232:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1789896041.461244:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003559936 00000100:00100000:0.0:1789896041.461244:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3617:x1876838003561088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896041.461245:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789896041.461248:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003559936 00010000:00010000:1.0:1789896041.461255:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2440 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2439 expref: 21 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896041.461259:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896041.461264:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a244e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2447 expref: 21 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896041.461266:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa72d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003560960:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896041.461266:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2401 expref: 21 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.461273:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2440 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2439 expref: 21 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896041.461292:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789896041.461293:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2401 expref: 21 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.461298:0:198252:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003560960 00010000:00010000:1.0:1789896041.461308:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5b000/0x412fd4b3617a2440 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2439 expref: 21 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.461309:0:198252:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003560960 00000100:00100000:3.0:1789896041.461311:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003559808:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789896041.461311:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8000/0x412fd4b3617a2408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2401 expref: 21 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.461325:0:198252:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2416 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a240f expref: 22 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896041.461328:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003560704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789896041.461329:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789896041.461340:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789896041.461351:0:198252:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00000100:00100000:2.0:1789896041.461359:0:198252:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3615:x1876838003559936:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896041.461366:0:191756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00010000:00010000:2.0:1789896041.461366:0:198252:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896041.461372:0:198252:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a244e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a2447 expref: 20 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896041.461379:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a51850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3617:x1876838003560320:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896041.461381:0:191756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3615:x1876838003560960:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789896041.461381:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:3617:x1876838003561088:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (235us total) trans 0 rc 0/0 00010000:00010000:2.0:1789896041.461386:0:198252:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a244e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a2447 expref: 20 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896041.461399:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00010000:00010000:3.0:1789896041.461406:0:191756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789896041.461408:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00010000:00010000:3.0:1789896041.461415:0:191756:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2416 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x412fd4b3617a240f expref: 19 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.461415:0:198252:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91a948c5a400/0x412fd4b3617a244e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a2447 expref: 19 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.461439:0:191756:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2416 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x412fd4b3617a240f expref: 17 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.461446:0:198252:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789896041.461453:0:191756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a2416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x412fd4b3617a240f expref: 17 pid: 188725 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789896041.461463:0:191756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789896041.461472:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a947f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003560320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789896041.461485:0:198252:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3615:x1876838003559936:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896041.461488:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948bc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3617:1876838003561088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789896041.461498:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a95085aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003559936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896041.461499:0:191756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:3615:x1876838003560960:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896041.461503:0:198252:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00100000:1.0:1789896041.461521:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa72d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3615:1876838003560960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789896041.461600:0:191756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:2.0:1789896041.461682:0:214540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b77100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003560576:192.168.202.44@tcp:104: 00000100:00100000:2.0:1789896041.461691:0:214540:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:214540:1876838003560832:192.168.202.44@tcp:104: 00010000:00010000:2.0:1789896041.461721:0:214540:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896041.461981:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896041.462045:0:188717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015958016 00000100:00100000:2.0:1789896041.462050:0:188717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015958016 00010000:00010000:2.0:1789896041.462065:0:188717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a23ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f616 expref: 10 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896041.462104:0:188717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 515 00000100:00100000:2.0:1789896041.462113:0:188717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f6720b-db77-464e-82b6-5f314c431303+10:2403:x1876838015958016:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789896041.462123:0:188717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789896041.462128:0:188717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a23ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f616 expref: 10 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.462139:0:188717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a23ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f616 expref: 10 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896041.462142:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00010000:00010000:2.0:1789896041.462156:0:188717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e8e00/0x412fd4b3617a23ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f616 expref: 10 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.462167:0:188717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789896041.462189:0:188716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015957888 00000100:00100000:1.0:1789896041.462194:0:188716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015957888 00000100:00100000:2.0:1789896041.462228:0:188717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea05500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a6f6720b-db77-464e-82b6-5f314c431303+9:2403:x1876838015958016:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 86us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896041.462237:0:188717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 515 00010000:00010000:1.0:1789896041.462245:0:188716:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a23e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f60f expref: 10 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896041.462286:0:188716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 516 00000100:00100000:1.0:1789896041.462295:0:188716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947a53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f6720b-db77-464e-82b6-5f314c431303+9:2403:x1876838015957888:12345-192.168.202.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789896041.462312:0:188716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789896041.462318:0:188716:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a23e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f60f expref: 9 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.462330:0:188716:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a23e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f60f expref: 9 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.462343:0:188716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a23e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f60f expref: 9 pid: 188726 timeout: 4013 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.462356:0:188716:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.462365:0:188716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.462379:0:188716:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.462387:0:188716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.462394:0:188716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.462401:0:188716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.462407:0:188716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91aa654e9e00 already unused, calling callback (ffffffffc0c2e250) 00010000:00010000:1.0:1789896041.462411:0:188716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.462436:0:188716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.462452:0:188716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789896041.462464:0:188716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789896041.462476:0:214540:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.462486:0:214540:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896041.462497:0:214540:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a2471 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 214540 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789896041.462497:0:188716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947a53850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a6f6720b-db77-464e-82b6-5f314c431303+8:2403:x1876838015957888:12345-192.168.202.44@tcp:103:ldlm_bl.0 Request processed in 200us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896041.462514:0:188716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 516 00000100:00100000:0.0:1789896041.900362:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789896041.900383:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a949fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003561472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789896041.900444:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896041.900489:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003561344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789896041.900497:0:190238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003561472 00000100:00100000:3.0:1789896041.900506:0:190238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003561472 00000100:00100000:0.0:1789896041.900528:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789896041.900569:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789896041.900579:0:190238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789896041.900592:0:190238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003561472:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789896041.900596:0:188735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003561344 00000100:00100000:2.0:1789896041.900602:0:188735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003561344 00002000:00000024:3.0:1789896041.900621:0:190238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896041.900642:0:188735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1789896041.900658:0:188735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003561344:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789896041.900669:0:190238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003561472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896041.900675:0:190238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000004:00000024:2.0:1789896041.900683:0:188735:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445814272 avail 1299574784 00000100:00100000:1.0:1789896041.900719:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a949fc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003561472:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789896041.900728:0:188735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003561344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896041.900736:0:188735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789896041.900738:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003561344:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789896042.476412:0:190258:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789896042.796251:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896042.796260:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a9515d5800 from 171 10000000:01000000:0.0:1789896042.796266:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896042.796314:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.796324:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.796333:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.796353:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003561600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.796409:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.796447:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.796458:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003561600 00000100:00100000:2.0:1789896042.796467:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003561600 00000100:00100000:2.0:1789896042.796523:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2167 00000100:00100000:2.0:1789896042.796532:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+15:188728:x1876838003561600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896042.796545:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896042.796559:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a247f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2478 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.796592:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a247f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2478 expref: 16 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.796604:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9e00/0x412fd4b3617a247f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2478 expref: 16 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.796613:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9e00, rc 0) 00000100:00100000:2.0:1789896042.796657:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003561600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.796665:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2167 00000100:00100000:0.0:1789896042.796693:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003561600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896042.796707:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a247f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.796714:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a247f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.796766:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003561728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.796784:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.796799:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.796825:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003561728 00000100:00100000:2.0:1789896042.796829:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003561728 00000100:00100000:2.0:1789896042.796859:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2168 00000100:00100000:2.0:1789896042.796865:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003561728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.796998:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003561728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.797030:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2168 00000100:00100000:0.0:1789896042.797060:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003561728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.797098:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003561856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.797136:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.797158:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.797184:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003561856 00000100:00100000:2.0:1789896042.797189:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003561856 00000100:00100000:2.0:1789896042.797237:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2169 00000100:00100000:2.0:1789896042.797244:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003561856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.797324:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa6fb81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003561856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.797330:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2169 00000100:00100000:0.0:1789896042.797365:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003561856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.797612:0:214541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214541:1876838003561984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.797646:0:214541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.797671:0:214541:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.797683:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003561984 00000100:00100000:2.0:1789896042.797688:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003561984 00000100:00100000:2.0:1789896042.797711:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2170 00000100:00100000:2.0:1789896042.797717:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214541:x1876838003561984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.797797:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214541:x1876838003561984:12345-0@lo:502:llog_process_th.0 Request processed in 79us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.797804:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2170 00000100:00100000:0.0:1789896042.797823:0:214541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214541:1876838003561984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.797874:0:214541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214541:1876838003562112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.797907:0:214541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.797923:0:214541:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa515f7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.797932:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003562112 00000100:00100000:2.0:1789896042.797937:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003562112 00000100:00100000:2.0:1789896042.797959:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2171 00000100:00100000:2.0:1789896042.797965:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214541:x1876838003562112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.798034:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:214541:x1876838003562112:12345-0@lo:502:llog_process_th.0 Request processed in 68us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.798042:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2171 00000100:00100000:0.0:1789896042.798055:0:214541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214541:1876838003562112:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789896042.798078:0:214541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000020:01000000:2.0:1789896042.798138:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 171-173 (rc=0) 10000000:01000000:2.0:1789896042.798159:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789896042.798166:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a247f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.798180:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b600/0x412fd4b3617a2478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a247f expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789896042.798188:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789896042.798191:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:2.0:1789896042.798193:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789896042.798224:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.798232:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.798239:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896042.798252:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003562240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.798277:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.798295:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003562240 00000100:00100000:0.0:1789896042.798299:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003562240 00000100:00100000:2.0:1789896042.798302:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94711cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896042.798324:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2172 00000100:00100000:0.0:1789896042.798329:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+16:188728:x1876838003562240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896042.798334:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789896042.798341:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a248d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2486 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.798353:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a248d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2486 expref: 17 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.798359:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91a948c5be00/0x412fd4b3617a248d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2486 expref: 17 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.798369:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91a948c5be00, rc 0) 00000100:00100000:0.0:1789896042.798393:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003562240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 64us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.798398:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2172 00000100:00100000:2.0:1789896042.798414:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003562240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896042.798425:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a248d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.798433:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a248d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789896042.798470:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003562368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.798494:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.798517:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003562368 00000100:00100000:2.0:1789896042.798518:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94711cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896042.798521:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003562368 00000100:00100000:0.0:1789896042.798542:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2173 00000100:00100000:0.0:1789896042.798545:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003562368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.798599:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5d8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003562368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 52us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.798604:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2173 00000100:00100000:2.0:1789896042.798620:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003562368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.798645:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003562496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.798676:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896042.798691:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a94711cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896042.798692:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003562496 00000100:00100000:0.0:1789896042.798697:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003562496 00000100:00100000:0.0:1789896042.798717:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2174 00000100:00100000:0.0:1789896042.798720:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003562496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.798771:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5dac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003562496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 50us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.798776:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2174 00000100:00100000:2.0:1789896042.798794:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003562496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789896042.799391:0:214542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:0.0:1789896042.799443:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:0.0:1789896042.799460:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789896042.799464:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a248d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.799469:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91aa654e8e00/0x412fd4b3617a2486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a248d expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896042.799482:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896042.799483:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91aa4787f800 from 171 10000000:01000000:0.0:1789896042.799485:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896042.799495:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.799499:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.799504:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.799512:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003562624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.799530:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896042.799553:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003562624 00000100:00100000:0.0:1789896042.799554:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.799559:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003562624 00000100:00100000:2.0:1789896042.799586:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2175 00000100:00100000:2.0:1789896042.799592:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+17:188728:x1876838003562624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896042.799599:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896042.799606:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a249b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a2494 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.799620:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a249b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a2494 expref: 18 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.799628:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9000/0x412fd4b3617a249b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a2494 expref: 18 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.799634:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9000, rc 0) 00000100:00100000:2.0:1789896042.799666:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003562624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.799673:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2175 00000100:00100000:0.0:1789896042.799684:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003562624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896042.799694:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a249b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.799699:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a249b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.799725:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003562752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.799740:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.799752:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.799761:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003562752 00000100:00100000:2.0:1789896042.799766:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003562752 00000100:00100000:2.0:1789896042.799795:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2176 00000100:00100000:2.0:1789896042.799802:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003562752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.799864:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003562752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.799872:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2176 00000100:00100000:0.0:1789896042.799885:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003562752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.799914:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003562880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.799937:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.799949:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.799956:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003562880 00000100:00100000:2.0:1789896042.799961:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003562880 00000100:00100000:2.0:1789896042.799985:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2177 00000100:00100000:2.0:1789896042.799991:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003562880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.800062:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94dd3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003562880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.800069:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2177 00000100:00100000:0.0:1789896042.800072:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003562880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.800261:0:214543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214543:1876838003563008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.800292:0:214543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.800310:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003563008 00000100:00100000:0.0:1789896042.800314:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003563008 00000100:00100000:2.0:1789896042.800317:0:214543:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa51293900 going to sleep for 11 seconds 00000100:00100000:0.0:1789896042.800338:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2178 00000100:00100000:0.0:1789896042.800342:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214543:x1876838003563008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.800416:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214543:x1876838003563008:12345-0@lo:502:llog_process_th.0 Request processed in 72us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.800422:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2178 00000100:00100000:2.0:1789896042.800430:0:214543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214543:1876838003563008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.800468:0:214543:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214543:1876838003563136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.800498:0:214543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896042.800515:0:214543:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa51293900 going to sleep for 11 seconds 00000100:00100000:0.0:1789896042.800515:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003563136 00000100:00100000:0.0:1789896042.800520:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003563136 00000100:00100000:0.0:1789896042.800538:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2179 00000100:00100000:0.0:1789896042.800542:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214543:x1876838003563136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.800590:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:214543:x1876838003563136:12345-0@lo:502:llog_process_th.0 Request processed in 46us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.800594:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2179 00000100:00100000:2.0:1789896042.800604:0:214543:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214543:1876838003563136:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896042.800628:0:214543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000020:01000000:0.0:1789896042.800661:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 171-173 (rc=0) 10000000:01000000:0.0:1789896042.800677:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896042.800681:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a249b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.800687:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5ac00/0x412fd4b3617a2494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a249b expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896042.800700:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789896042.800701:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:0.0:1789896042.800702:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789896042.800712:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.800716:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.800721:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.800728:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003563264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.800745:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.800757:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fb300 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.800767:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003563264 00000100:00100000:2.0:1789896042.800772:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003563264 00000100:00100000:2.0:1789896042.800796:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2180 00000100:00100000:2.0:1789896042.800802:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+18:188728:x1876838003563264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896042.800814:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896042.800823:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a24a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a24a2 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.800835:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a24a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a24a2 expref: 19 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.800843:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8600/0x412fd4b3617a24a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a24a2 expref: 19 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.800849:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8600, rc 0) 00000100:00100000:2.0:1789896042.800880:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003563264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.800888:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2180 00000100:00100000:0.0:1789896042.800895:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003563264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896042.800905:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24a9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.800910:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a24a9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.800934:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003563392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.800950:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.800962:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fb300 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.800970:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003563392 00000100:00100000:2.0:1789896042.800975:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003563392 00000100:00100000:2.0:1789896042.800997:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2181 00000100:00100000:2.0:1789896042.801003:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003563392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.801074:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003563392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.801081:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2181 00000100:00100000:0.0:1789896042.801085:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003563392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.801110:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003563520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.801133:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.801145:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fb300 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.801152:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003563520 00000100:00100000:2.0:1789896042.801156:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003563520 00000100:00100000:2.0:1789896042.801178:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2182 00000100:00100000:2.0:1789896042.801185:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003563520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.801269:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003563520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.801274:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003563520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.801286:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2182 00000040:00080000:2.0:1789896042.801847:0:214544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:0.0:1789896042.801894:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:0.0:1789896042.801910:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789896042.801914:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24a9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.801919:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a800/0x412fd4b3617a24a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24a9 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896042.801923:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896042.801924:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a949395000 from 171 10000000:01000000:0.0:1789896042.801926:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896042.801938:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.801945:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.801952:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.801964:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003563648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.801986:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896042.802008:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003563648 00000100:00100000:0.0:1789896042.802022:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fb300 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.802024:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003563648 00000100:00100000:2.0:1789896042.802051:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2183 00000100:00100000:2.0:1789896042.802057:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+19:188728:x1876838003563648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896042.802063:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896042.802071:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a24b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a24b0 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.802083:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a24b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a24b0 expref: 20 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.802091:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8400/0x412fd4b3617a24b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a24b0 expref: 20 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.802098:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8400, rc 0) 00000100:00100000:2.0:1789896042.802132:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003563648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.802138:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2183 00000100:00100000:0.0:1789896042.802157:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003563648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896042.802174:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24b7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.802182:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a24b7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.802230:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003563776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.802254:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896042.802277:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003563776 00000100:00100000:0.0:1789896042.802280:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fb300 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.802283:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003563776 00000100:00100000:2.0:1789896042.802309:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2184 00000100:00100000:2.0:1789896042.802316:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003563776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.802374:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003563776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.802381:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2184 00000100:00100000:0.0:1789896042.802389:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003563776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.802415:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003563904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.802447:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.802463:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fb300 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.802467:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003563904 00000100:00100000:2.0:1789896042.802472:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003563904 00000100:00100000:2.0:1789896042.802495:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2185 00000100:00100000:2.0:1789896042.802501:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003563904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.802558:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003563904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 57us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.802566:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2185 00000100:00100000:0.0:1789896042.802567:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003563904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.802779:0:214545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214545:1876838003564032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.802810:0:214545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896042.802829:0:214545:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa412ed000 going to sleep for 11 seconds 00000100:00100000:0.0:1789896042.802829:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003564032 00000100:00100000:0.0:1789896042.802834:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003564032 00000100:00100000:0.0:1789896042.802860:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2186 00000100:00100000:0.0:1789896042.802867:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214545:x1876838003564032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.802933:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214545:x1876838003564032:12345-0@lo:502:llog_process_th.0 Request processed in 66us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.802940:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2186 00000100:00100000:2.0:1789896042.802946:0:214545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214545:1876838003564032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.802984:0:214545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214545:1876838003564160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.803027:0:214545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896042.803042:0:214545:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa454559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789896042.803046:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003564160 00000100:00100000:0.0:1789896042.803050:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003564160 00000100:00100000:0.0:1789896042.803070:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2187 00000100:00100000:0.0:1789896042.803074:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214545:x1876838003564160:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.803131:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:214545:x1876838003564160:12345-0@lo:502:llog_process_th.0 Request processed in 55us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.803138:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2187 00000100:00100000:2.0:1789896042.803143:0:214545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214545:1876838003564160:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789896042.803165:0:214545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000020:01000000:0.0:1789896042.803221:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 171-173 (rc=0) 10000000:01000000:0.0:1789896042.803236:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896042.803240:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24b7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.803246:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5ba00/0x412fd4b3617a24b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24b7 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896042.803252:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789896042.803253:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 197 10000000:01000000:0.0:1789896042.803254:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789896042.803265:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.803269:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.803274:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.803282:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003564288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.803298:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.803320:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.803321:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003564288 00000100:00100000:2.0:1789896042.803326:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003564288 00000100:00100000:2.0:1789896042.803356:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2188 00000100:00100000:2.0:1789896042.803362:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+20:188728:x1876838003564288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896042.803368:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896042.803377:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a24c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a24be expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.803389:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a24c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a24be expref: 21 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.803407:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9400/0x412fd4b3617a24c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a24be expref: 21 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.803413:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9400, rc 0) 00000100:00100000:2.0:1789896042.803442:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003564288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.803449:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2188 00000100:00100000:0.0:1789896042.803455:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003564288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896042.803464:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24c5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.803475:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a24c5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.803498:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003564416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.803515:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.803527:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.803536:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003564416 00000100:00100000:2.0:1789896042.803540:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003564416 00000100:00100000:2.0:1789896042.803563:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2189 00000100:00100000:2.0:1789896042.803569:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003564416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.803630:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003564416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.803639:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003564416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.803640:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2189 00000100:00100000:0.0:1789896042.803663:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003564544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.803688:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.803700:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fbb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.803706:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003564544 00000100:00100000:2.0:1789896042.803711:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003564544 00000100:00100000:2.0:1789896042.803734:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2190 00000100:00100000:2.0:1789896042.803739:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003564544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.803801:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003564544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.803808:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003564544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.803809:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2190 00000100:00100000:2.0:1789896042.803973:0:214546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214546:1876838003564672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.804002:0:214546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.804030:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003564672 00000100:00100000:2.0:1789896042.804031:0:214546:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45455a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896042.804034:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003564672 00000100:00100000:0.0:1789896042.804056:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2191 00000100:00100000:0.0:1789896042.804060:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214546:x1876838003564672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.804120:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214546:x1876838003564672:12345-0@lo:502:llog_process_th.0 Request processed in 58us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.804128:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2191 00000100:00100000:2.0:1789896042.804135:0:214546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214546:1876838003564672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789896042.804164:0:214546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789896042.804172:0:214546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896042.804175:0:214546:0:(obd_config.c:1561:class_process_config()) marker 187 (0x1) lustre-MDT0001-m add lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:2.0:1789896042.804180:0:214546:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1789896042.804195:0:214546:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool2 as member 1 00000100:00100000:2.0:1789896042.804239:0:214546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214546:1876838003564800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.804270:0:214546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.804289:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003564800 00000100:00100000:0.0:1789896042.804293:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003564800 00000100:00100000:2.0:1789896042.804294:0:214546:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45455a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789896042.804316:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2192 00000100:00100000:0.0:1789896042.804320:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214546:x1876838003564800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.804370:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a947cfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:214546:x1876838003564800:12345-0@lo:502:llog_process_th.0 Request processed in 48us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.804382:0:214546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214546:1876838003564800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.804389:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2192 00000020:01000000:2.0:1789896042.804405:0:214546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789896042.804411:0:214546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896042.804412:0:214546:0:(obd_config.c:1561:class_process_config()) marker 187 (0x2) lustre-MDT0001-m add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:2.0:1789896042.804416:0:214546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 200 count 196 00000020:01000000:0.0:1789896042.804449:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 197-199 (rc=0) 10000000:01000000:0.0:1789896042.804462:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789896042.804467:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24c5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.804472:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b800/0x412fd4b3617a24be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24c5 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896042.804477:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789896042.804479:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff91a952404000 from 171 10000000:01000000:0.0:1789896042.804480:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789896042.804489:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.804494:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.804499:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.804506:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003564928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.804522:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.804534:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.804543:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003564928 00000100:00100000:2.0:1789896042.804548:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003564928 00000100:00100000:2.0:1789896042.804571:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2193 00000100:00100000:2.0:1789896042.804577:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+21:188728:x1876838003564928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896042.804584:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896042.804592:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a24d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a24cc expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.804604:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a24d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a24cc expref: 22 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.804612:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9800/0x412fd4b3617a24d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a24cc expref: 22 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.804619:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9800, rc 0) 00000100:00100000:2.0:1789896042.804655:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003564928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.804663:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003564928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.804664:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2193 00010000:00010000:0.0:1789896042.804675:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24d3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.804689:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a24d3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.804712:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003565056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.804728:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.804740:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.804748:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003565056 00000100:00100000:2.0:1789896042.804753:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003565056 00000100:00100000:2.0:1789896042.804775:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2194 00000100:00100000:2.0:1789896042.804781:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003565056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.804840:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003565056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.804847:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2194 00000100:00100000:0.0:1789896042.804849:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003565056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.804874:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003565184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.804904:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.804916:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.804924:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003565184 00000100:00100000:2.0:1789896042.804928:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003565184 00000100:00100000:2.0:1789896042.804952:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2195 00000100:00100000:2.0:1789896042.804958:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003565184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.805028:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003565184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.805034:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2195 00000100:00100000:0.0:1789896042.805039:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003565184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.805218:0:214547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214547:1876838003565312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.805248:0:214547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.805271:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003565312 00000100:00100000:2.0:1789896042.805275:0:214547:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45257780 going to sleep for 11 seconds 00000100:00100000:0.0:1789896042.805277:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003565312 00000100:00100000:0.0:1789896042.805306:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2196 00000100:00100000:0.0:1789896042.805313:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214547:x1876838003565312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.805385:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214547:x1876838003565312:12345-0@lo:502:llog_process_th.0 Request processed in 71us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.805392:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2196 00000100:00100000:2.0:1789896042.805395:0:214547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214547:1876838003565312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.805431:0:214547:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214547:1876838003565440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.805459:0:214547:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896042.805474:0:214547:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa45257780 going to sleep for 11 seconds 00000100:00100000:0.0:1789896042.805481:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003565440 00000100:00100000:0.0:1789896042.805486:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003565440 00000100:00100000:0.0:1789896042.805512:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2197 00000100:00100000:0.0:1789896042.805520:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214547:x1876838003565440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.805585:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:214547:x1876838003565440:12345-0@lo:502:llog_process_th.0 Request processed in 66us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.805596:0:214547:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214547:1876838003565440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.805602:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2197 00000040:00080000:2.0:1789896042.805627:0:214547:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000020:01000000:0.0:1789896042.805664:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 171-173 (rc=0) 10000000:01000000:0.0:1789896042.805683:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789896042.805688:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24d3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.805696:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a600/0x412fd4b3617a24cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24d3 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896042.805703:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789896042.805704:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 197 10000000:01000000:0.0:1789896042.805707:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789896042.805721:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.805728:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.805735:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.805747:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003565568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.805770:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.805787:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.805792:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003565568 00000100:00100000:2.0:1789896042.805797:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003565568 00000100:00100000:2.0:1789896042.805820:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2198 00000100:00100000:2.0:1789896042.805827:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+22:188728:x1876838003565568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896042.805834:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896042.805841:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a24e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a24da expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.805853:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a24e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a24da expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.805860:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e8a00/0x412fd4b3617a24e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a24da expref: 23 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.805867:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e8a00, rc 0) 00000100:00100000:2.0:1789896042.805894:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003565568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.805901:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2198 00000100:00100000:0.0:1789896042.805910:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003565568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896042.805922:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24e1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.805940:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a24e1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.805973:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003565696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.805998:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.806028:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.806031:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003565696 00000100:00100000:2.0:1789896042.806036:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003565696 00000100:00100000:2.0:1789896042.806059:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2199 00000100:00100000:2.0:1789896042.806066:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003565696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.806126:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003565696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.806134:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2199 00000100:00100000:0.0:1789896042.806141:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003565696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.806166:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003565824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.806195:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896042.806231:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003565824 00000100:00100000:0.0:1789896042.806237:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fb600 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.806241:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003565824 00000100:00100000:2.0:1789896042.806270:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2200 00000100:00100000:2.0:1789896042.806277:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003565824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.806337:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003565824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.806345:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2200 00000100:00100000:0.0:1789896042.806352:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003565824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.806514:0:214548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214548:1876838003565952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789896042.806546:0:214548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896042.806564:0:214548:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9534da300 going to sleep for 11 seconds 00000100:00100000:0.0:1789896042.806571:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003565952 00000100:00100000:0.0:1789896042.806575:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003565952 00000100:00100000:0.0:1789896042.806601:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2201 00000100:00100000:0.0:1789896042.806609:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214548:x1876838003565952:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.806685:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214548:x1876838003565952:12345-0@lo:502:llog_process_th.0 Request processed in 76us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896042.806692:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2201 00000100:00100000:2.0:1789896042.806695:0:214548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214548:1876838003565952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789896042.806719:0:214548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789896042.806725:0:214548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896042.806727:0:214548:0:(obd_config.c:1561:class_process_config()) marker 186 (0x1) lustre-MDT0000-m add lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:2.0:1789896042.806731:0:214548:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1789896042.806740:0:214548:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool2 as member 1 00000020:01000004:2.0:1789896042.807026:0:214549:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91a952404000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789896042.807030:0:214549:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91a952404000 4 00000100:00100000:1.0:1789896042.807036:0:214548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214548:1876838003566080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789896042.807070:0:214548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896042.807091:0:214548:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9488e5240 going to sleep for 11 seconds 00000100:00100000:0.0:1789896042.807109:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003566080 00000100:00100000:0.0:1789896042.807114:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003566080 00000100:00100000:0.0:1789896042.807149:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2202 00000100:00100000:0.0:1789896042.807157:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214548:x1876838003566080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.807246:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:214548:x1876838003566080:12345-0@lo:502:llog_process_th.0 Request processed in 88us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.807259:0:214548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:214548:1876838003566080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789896042.807265:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2202 00000020:01000000:2.0:1789896042.807285:0:214548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789896042.807291:0:214548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789896042.807293:0:214548:0:(obd_config.c:1561:class_process_config()) marker 186 (0x2) lustre-MDT0000-m add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:2.0:1789896042.807297:0:214548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 200 count 196 00000020:01000000:0.0:1789896042.807334:0:188728:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 197-199 (rc=0) 10000000:01000000:0.0:1789896042.807353:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789896042.807359:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24e1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.807368:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5b000/0x412fd4b3617a24da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24e1 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789896042.807376:0:188728:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789896042.807378:0:188728:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff91aa66208000 from 1 10000000:01000000:0.0:1789896042.807380:0:188728:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789896042.807394:0:188728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.807402:0:188728:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.807409:0:188728:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.807422:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003566208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.807447:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896042.807470:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003566208 00000100:00100000:0.0:1789896042.807475:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.807476:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003566208 00000100:00100000:2.0:1789896042.807506:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2203 00000100:00100000:2.0:1789896042.807512:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+23:188728:x1876838003566208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896042.807519:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896042.807532:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a24ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x412fd4b3617a24e8 expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.807546:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a24ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x412fd4b3617a24e8 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.807554:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9200/0x412fd4b3617a24ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x412fd4b3617a24e8 expref: 24 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.807562:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9200, rc 0) 00000100:00100000:2.0:1789896042.807592:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003566208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.807599:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2203 00000100:00100000:0.0:1789896042.807618:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003566208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789896042.807629:0:188728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24ef expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.807647:0:188728:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x412fd4b3617a24ef expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789896042.807682:0:188728:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003566336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789896042.807707:0:188728:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896042.807726:0:188728:0:(client.c:2702:ptlrpc_set_wait()) set ffff91a9528fbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789896042.807728:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003566336 00000100:00100000:2.0:1789896042.807733:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003566336 00000100:00100000:2.0:1789896042.807755:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2204 00000100:00100000:2.0:1789896042.807761:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003566336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.807804:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:188728:x1876838003566336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 43us (95us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789896042.807811:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2204 00000100:00100000:0.0:1789896042.807821:0:188728:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea04000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:188728:1876838003566336:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789896042.807842:0:188728:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.202.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789896042.807847:0:188728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24ef expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789896042.807854:0:188728:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.144@tcp lock: ffff91a948c5a400/0x412fd4b3617a24e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x412fd4b3617a24ef expref: -99 pid: 188728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789896042.995591:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896042.995651:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015958144 00000100:00100000:2.0:1789896042.995661:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015958144 00000100:00100000:2.0:1789896042.995714:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2205 00000100:00100000:2.0:1789896042.995725:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+8:191651:x1876838015958144:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896042.995740:0:188725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896042.995757:0:188725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a24f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f61d expref: -99 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.995783:0:188725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a24f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f61d expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.995806:0:188725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9600/0x412fd4b3617a24f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f61d expref: 9 pid: 188725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896042.995816:0:188725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9600, rc 0) 00000100:00100000:2.0:1789896042.995866:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015958144:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 143us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.995873:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2205 00000100:00100000:0.0:1789896042.996689:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896042.996738:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015958272 00000100:00100000:2.0:1789896042.996743:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015958272 00000100:00100000:2.0:1789896042.996770:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2206 00000100:00100000:2.0:1789896042.996777:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015958272:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.996869:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa7fca5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015958272:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 93us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.996875:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2206 00000100:00100000:0.0:1789896042.997499:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896042.997544:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015958400 00000100:00100000:2.0:1789896042.997549:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015958400 00000100:00100000:2.0:1789896042.997576:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2207 00000100:00100000:2.0:1789896042.997583:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015958400:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789896042.997671:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50577050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015958400:12345-192.168.202.44@tcp:503:ll_cfg_requeue.0 Request processed in 87us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.997677:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2207 00000100:00100000:3.0:1789896042.998567:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896042.998597:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015958528 00000100:00100000:2.0:1789896042.998601:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015958528 00000100:00100000:2.0:1789896042.998621:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2208 00000100:00100000:2.0:1789896042.998626:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:213796:x1876838015958528:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896042.998716:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50576850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:213796:x1876838015958528:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 89us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.998724:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2208 00000100:00100000:0.0:1789896042.999383:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896042.999430:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015958656 00000100:00100000:2.0:1789896042.999435:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015958656 00000100:00100000:2.0:1789896042.999459:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2209 00000100:00100000:2.0:1789896042.999467:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:213796:x1876838015958656:12345-192.168.202.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789896042.999527:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+9:213796:x1876838015958656:12345-192.168.202.44@tcp:502:llog_process_th.0 Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896042.999535:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2209 00000100:00100000:0.0:1789896043.000346:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896043.000382:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015958784 00000100:00100000:2.0:1789896043.000388:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015958784 00000100:00100000:2.0:1789896043.000412:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2210 00000100:00100000:2.0:1789896043.000418:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+9:191651:x1876838015958784:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789896043.000426:0:188726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789896043.000440:0:188726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a24fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xbcfa502c8f06f624 expref: -99 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896043.000459:0:188726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a24fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f624 expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896043.000470:0:188726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91aa654e9c00/0x412fd4b3617a24fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.44@tcp remote: 0xbcfa502c8f06f624 expref: 10 pid: 188726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789896043.000477:0:188726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91aa654e9c00, rc 0) 00000100:00100000:2.0:1789896043.000506:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015958784:12345-192.168.202.44@tcp:101:ll_cfg_requeue.0 Request processed in 88us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896043.000520:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2210 00000100:00100000:3.0:1789896043.001122:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896043.001160:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015958912 00000100:00100000:2.0:1789896043.001165:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015958912 00000100:00100000:2.0:1789896043.001188:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2211 00000100:00100000:2.0:1789896043.001195:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015958912:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789896043.001288:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50575c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a6f6720b-db77-464e-82b6-5f314c431303+10:191651:x1876838015958912:12345-192.168.202.44@tcp:501:ll_cfg_requeue.0 Request processed in 94us (166us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789896043.001296:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2211 00010000:00010000:1.0:1789896043.500348:0:205054:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789896043.798312:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896043.798356:0:188731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015959040 00000100:00100000:2.0:1789896043.798367:0:188731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015959040 00000100:00080000:0.0:1789896043.798421:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789896043.798433:0:188731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2794 00000100:00100000:2.0:1789896043.798444:0:188731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213816:x1876838015959040:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:1.0:1789896043.799576:0:188731:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a948ee3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:188731:1876838003566464:0@lo:19:mdt00_001.0 00000100:00100000:1.0:1789896043.799622:0:188731:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896043.799651:0:191519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003566464 00000100:00100000:1.0:1789896043.799652:0:188731:0:(client.c:2702:ptlrpc_set_wait()) set ffff91aa452a6540 going to sleep for 11 seconds 00000100:00100000:3.0:1789896043.799659:0:191519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003566464 00000100:00100000:3.0:1789896043.799718:0:191519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1789896043.799720:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789896043.799730:0:191519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:188731:x1876838003566464:12345-0@lo:19:mdt00_001.0 00000100:00100000:3.0:1789896043.799888:0:191519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:188731:x1876838003566464:12345-0@lo:19:mdt00_001.0 Request processed in 164us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896043.799894:0:191519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789896043.799927:0:188731:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a948ee3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:188731:1876838003566464:0@lo:19:mdt00_001.0 00000100:00100000:1.0:1789896043.800010:0:188731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213816:x1876838015959040:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1556us (1690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896043.800019:0:188731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2794 00000100:00100000:0.0:1789896043.800853:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896043.800874:0:190608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015959168 00000100:00100000:3.0:1789896043.800878:0:190608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015959168 00000100:00100000:3.0:1789896043.800903:0:190608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2795 00000100:00100000:3.0:1789896043.800908:0:190608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94ea04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213816:x1876838015959168:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:3.0:1789896043.802362:0:190608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94ea04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:213816:x1876838015959168:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 1451us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896043.802371:0:190608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2795 00000100:00100000:3.0:1789896044.403523:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896044.403567:0:188726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015959296 00000100:00100000:3.0:1789896044.403570:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:2.0:1789896044.403576:0:188726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015959296 00000100:00100000:3.0:1789896044.403611:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896044.403631:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015959424 00000100:00100000:1.0:1789896044.403637:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015959424 00000100:00100000:2.0:1789896044.403639:0:188726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2212 00000100:00100000:2.0:1789896044.403649:0:188726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:2404:x1876838015959296:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789896044.403663:0:188730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015959552 00000100:00100000:3.0:1789896044.403669:0:188730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015959552 00000100:00100000:1.0:1789896044.403681:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 513 00000100:00100000:1.0:1789896044.403699:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2403:x1876838015959424:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:3.0:1789896044.403713:0:188730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 514 00000100:00100000:2.0:1789896044.403722:0:188726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a6f6720b-db77-464e-82b6-5f314c431303+10:2404:x1876838015959296:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 73us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896044.403727:0:188730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2404:x1876838015959552:12345-192.168.202.44@tcp:400:kworker.0 00000100:00100000:2.0:1789896044.403735:0:188726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2212 00000100:00100000:1.0:1789896044.403735:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:2403:x1876838015959424:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 37us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896044.403742:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 513 00000100:00100000:3.0:1789896044.403774:0:188730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b605fe3a-6fcb-45ec-906b-e58490e4129a+5:2404:x1876838015959552:12345-192.168.202.44@tcp:400:kworker.0 Request processed in 51us (163us total) trans 0 rc 0/0 00000100:00080000:2.0:1789896044.403778:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789896044.403785:0:188730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 514 00010000:00010000:3.0:1789896044.524269:0:188720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789896044.620468:0:214697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3916928267516ns, next at 3819238265902ns, rc = 0 00080000:00080000:0.0:1789896044.620483:0:214697:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789896044.620588:0:214697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3916928388234ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789896044.620596:0:214697:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789896044.620683:0:214697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3916928483600ns, next at 3746909153849ns, rc = 0 00080000:00080000:0.0:1789896044.620690:0:214697:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789896044.620753:0:214697:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3916928553258ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789896044.620758:0:214697:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1789896044.621215:0:188711:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 44 committed 00000004:00080000:2.0:1789896044.621224:0:189463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 36 committed 00000004:00080000:1.0:1789896044.621625:0:188711:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 42 committed 00000004:00080000:2.0:1789896044.621683:0:189463:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 36 committed 00000100:00100000:1.0:1789896044.974228:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94ea06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003566592:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789896044.974264:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003566720:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789896044.974300:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896044.974302:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003566848:0@lo:400:kworker.0 00000100:00100000:2.0:1789896044.974348:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003566976:0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.974351:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003567104:0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.974360:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896044.974396:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003567360:0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.974397:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896044.974404:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896044.974406:0:190237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003566592 00000100:00100000:0.0:1789896044.974415:0:190237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003566592 00000100:00100000:1.0:1789896044.974419:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003567744:0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.974430:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789896044.974438:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003567488:0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.974445:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896044.974458:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003567872:0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.974468:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a946818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876838003568128:0@lo:400:kworker.0 00000100:00100000:0.0:1789896044.974484:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789896044.974491:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896044.974497:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896044.974497:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896044.974499:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003566592:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789896044.974526:0:3615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876838003568000:0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.974528:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789896044.974532:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876838003568384:0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.974536:0:3616:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876838003568512:0@lo:400:kworker.0 00002000:00000024:0.0:1789896044.974544:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896044.974570:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896044.974576:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896044.974576:0:191520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003567104 00000100:00100000:1.0:1789896044.974580:0:191520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003567104 00000100:00100000:1.0:1789896044.974614:0:191520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003567744 00000100:00100000:1.0:1789896044.974618:0:191520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003567744 00000100:00100000:3.0:1789896044.974622:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94d7bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003567232:0@lo:400:kworker.0 00000100:00100000:0.0:1789896044.974624:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003566592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 127us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896044.974636:0:188725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003566848 00000100:00100000:0.0:1789896044.974636:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789896044.974642:0:191520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003567872 00000100:00100000:2.0:1789896044.974643:0:188725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003566848 00000100:00100000:1.0:1789896044.974648:0:191520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003567872 00000100:00100000:3.0:1789896044.974653:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896044.974659:0:190237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003566720 00000100:00100000:0.0:1789896044.974665:0:190237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003566720 00000100:00100000:3.0:1789896044.974668:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003567616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789896044.974672:0:191520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003567232 00000100:00100000:1.0:1789896044.974676:0:191520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003567232 00000100:00100000:2.0:1789896044.974690:0:188725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2213 00000100:00100000:3.0:1789896044.974696:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789896044.974704:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789896044.974706:0:188725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3618:x1876838003566848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.974709:0:191520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789896044.974710:0:3617:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff91a94681ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876838003568256:0@lo:400:kworker.0 00000100:00100000:0.0:1789896044.974719:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876838003566720:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789896044.974722:0:191520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3616:x1876838003567104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.974738:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789896044.974742:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789896044.974767:0:188725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa50574c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace+24:3618:x1876838003566848:12345-0@lo:400:kworker.0 Request processed in 66us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896044.974777:0:191520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3616:x1876838003567104:12345-0@lo:400:kworker.0 Request processed in 57us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896044.974778:0:188725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2213 00000100:00100000:3.0:1789896044.974779:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003567360 00000100:00100000:3.0:1789896044.974783:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003567360 00000100:00100000:1.0:1789896044.974790:0:191520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789896044.974797:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876838003566720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896044.974806:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789896044.974810:0:191520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1789896044.974818:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003568128 00000100:00100000:1.0:1789896044.974820:0:191520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003567744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.974821:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003568128 00000100:00100000:2.0:1789896044.974826:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003566976 00000100:00100000:0.0:1789896044.974826:0:190237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003567616 00000100:00100000:2.0:1789896044.974833:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003566976 00000100:00100000:0.0:1789896044.974833:0:190237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003567616 00000100:00100000:3.0:1789896044.974845:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003568000 00000100:00100000:3.0:1789896044.974850:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003568000 00000100:00100000:1.0:1789896044.974852:0:191520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876838003567744:12345-0@lo:400:kworker.0 Request processed in 35us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896044.974859:0:191520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789896044.974869:0:190237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789896044.974871:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003568256 00000100:00100000:3.0:1789896044.974875:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003568256 00000100:00100000:1.0:1789896044.974876:0:191520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789896044.974878:0:192489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003567488 00000100:00100000:0.0:1789896044.974883:0:190237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876838003567616:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789896044.974885:0:192489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003567488 00000100:00100000:1.0:1789896044.974885:0:191520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003567872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.974893:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00002000:00000024:0.0:1789896044.974900:0:190237:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789896044.974903:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876838003567360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789896044.974917:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789896044.974925:0:191520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3618:x1876838003567872:12345-0@lo:400:kworker.0 Request processed in 42us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896044.974930:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003566976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.974938:0:191520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789896044.974952:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876838003567360:12345-0@lo:400:kworker.0 Request processed in 51us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789896044.974952:0:190237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1876838003567616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896044.974954:0:191520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789896044.974964:0:191520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3617:x1876838003567232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.974968:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:0.0:1789896044.974982:0:190237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789896044.974984:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876838003566976:12345-0@lo:400:kworker.0 Request processed in 57us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896044.975007:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:3.0:1789896044.975019:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3616:x1876838003568128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.975019:0:191520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3617:x1876838003567232:12345-0@lo:400:kworker.0 Request processed in 54us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896044.975025:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1789896044.975030:0:191520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789896044.975042:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1789896044.975049:0:192489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789896044.975056:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+11:3615:x1876838003568000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.975057:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3616:x1876838003568128:12345-0@lo:400:kworker.0 Request processed in 41us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896044.975063:0:192489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91aa77b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003567488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.975064:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789896044.975073:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:3.0:1789896044.975085:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003568512 00000100:00100000:3.0:1789896044.975088:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003568512 00000100:00100000:1.0:1789896044.975098:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3616:1876838003567104:0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.975113:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:1.0:1789896044.975113:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003567744:0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.975120:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a949fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876838003568256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789896044.975125:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+11:3615:x1876838003568000:12345-0@lo:400:kworker.0 Request processed in 72us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789896044.975129:0:192489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91aa77b74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876838003567488:12345-0@lo:400:kworker.0 Request processed in 68us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896044.975129:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a946818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3616:1876838003568128:0@lo:400:kworker.0 00000100:00100000:0.0:1789896044.975140:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1789896044.975144:0:192489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1789896044.975165:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a949fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1876838003568256:12345-0@lo:400:kworker.0 Request processed in 44us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896044.975168:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94ea06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3616:1876838003566592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789896044.975171:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00080000:2.0:1789896044.975173:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789896044.975180:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00080000:2.0:1789896044.975180:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789896044.975186:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876838003568512:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789896044.975188:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789896044.975220:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789896044.975245:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789896044.975261:0:213600:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838003568384 00000100:00100000:2.0:1789896044.975265:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3615:1876838003566976:0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.975266:0:213600:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838003568384 00000100:00100000:0.0:1789896044.975270:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876838003568512:12345-0@lo:400:kworker.0 Request processed in 86us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896044.975279:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d5aa9f28-852d-4c4c-aa1a-c6dc0dc42ace:3618:1876838003566848:0@lo:400:kworker.0 00000100:00100000:0.0:1789896044.975281:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1789896044.975290:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d544380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3615:1876838003567488:0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.975304:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876838003567360:0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.975304:0:213600:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1789896044.975313:0:3615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876838003568000:0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.975315:0:213600:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a948bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876838003568384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.975330:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3618:1876838003567872:0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.975354:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3618:1876838003568384:0@lo:400:kworker.0 00000100:00100000:1.0:1789896044.975354:0:213600:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a948bc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+8:3618:x1876838003568384:12345-0@lo:400:kworker.0 Request processed in 43us (109us total) trans 0 rc 0/0 00000100:00080000:2.0:1789896044.975357:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789896044.975362:0:213600:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00010000:00080000:0.0:1789896044.975373:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a94681b100 x1876838003568512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789896044.975385:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94d7bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003567232:0@lo:400:kworker.0 00000100:00100000:0.0:1789896044.975387:0:3616:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3616:1876838003568512:0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.975409:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91aa77b76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003567616:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789896044.975421:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91a94681ad80 x1876838003568256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789896060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789896044.975428:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a94681ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3617:1876838003568256:0@lo:400:kworker.0 00000100:00100000:3.0:1789896044.975436:0:3617:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff91a949fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3617:1876838003566720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789896045.059110:0:3610:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:1.0:1789896045.059153:0:192111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015959680 00000100:00100000:1.0:1789896045.059161:0:192111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015959680 00000100:00080000:3.0:1789896045.059253:0:188727:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789896045.059255:0:192111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2796 00000100:00100000:1.0:1789896045.059268:0:192111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a94681b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214006:x1876838015959680:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:1.0:1789896045.059380:0:192111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a94681b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214006:x1876838015959680:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 114us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789896045.059389:0:192111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2796 00000100:00100000:0.0:1789896045.069558:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.44@tcp (source: 12345-192.168.202.44@tcp) 00000100:00100000:3.0:1789896045.069620:0:188732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876838015959808 00000100:00100000:3.0:1789896045.069632:0:188732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876838015959808 00000100:00100000:3.0:1789896045.069687:0:188732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.44@tcp, seq: 2797 00000100:00100000:3.0:1789896045.069699:0:188732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91a946818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214008:x1876838015959808:12345-192.168.202.44@tcp:48:lfs.0 00000100:00100000:3.0:1789896045.069795:0:188732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91a946818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b605fe3a-6fcb-45ec-906b-e58490e4129a+6:214008:x1876838015959808:12345-192.168.202.44@tcp:48:lfs.0 Request processed in 99us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789896045.069804:0:188732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.44@tcp, seq: 2797 00000001:02000400:3.0:1789896045.528692:0:214794:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-quota test_71b: @@@@@@ FAIL: Used space(10240) for user quota_usr isn't 0. 00010000:00010000:0.0:1789896045.549360:0:188719:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 12100 lines, 12100 kept, 0 dropped, 0 bad.