00010000:00010000:3.0F:1767316152.215668:0:46026:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1767316153.241084:0:41158:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1767316153.583253:0:66726:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869277 is committed 00010000:00010000:1.0:1767316154.262817:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767316155.162634:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1767316155.162676:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1767316155.162706:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1767316155.162737:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1767316155.162764:0:44062:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331484928 00000100:00100000:3.0:1767316155.162774:0:44062:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331484928 00000100:00100000:3.0:1767316155.162825:0:44062:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331485056 00000100:00100000:3.0:1767316155.162829:0:44062:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331485056 00000100:00100000:3.0:1767316155.162848:0:44062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 344 00000100:00100000:3.0:1767316155.162871:0:44062:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5353c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+5:13817:x1853164331484928:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1767316155.162935:0:44062:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5353c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+5:13817:x1853164331484928:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 65us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316155.162942:0:44062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 344 00000100:00100000:3.0:1767316155.162957:0:44062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 345 00000100:00100000:3.0:1767316155.162964:0:44062:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5353c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+5:13815:x1853164331485056:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1767316155.162986:0:44062:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5353c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+5:13815:x1853164331485056:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 22us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316155.162991:0:44062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 345 00000100:00080000:3.0:1767316155.163008:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1767316155.163012:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1767316155.163467:0:66733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331484800 00000100:00100000:1.0:1767316155.163472:0:66733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331484800 00000100:00100000:1.0:1767316155.163512:0:66733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 78 00000100:00100000:1.0:1767316155.163518:0:66733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5353c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+5:13817:x1853164331484800:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1767316155.163557:0:66733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5353c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+5:13817:x1853164331484800:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 39us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.163563:0:66733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 78 00000100:00100000:0.0F:1767316155.163732:0:66742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331484544 00000100:00100000:0.0:1767316155.163748:0:66742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331484544 00000100:00100000:0.0:1767316155.163776:0:66742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 128 00000100:00100000:0.0:1767316155.163783:0:66742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40b1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf5678e5-f4dd-43cf-82e3-0b8dc9fe1870+9:13815:x1853164331484544:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1767316155.163813:0:66742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40b1ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf5678e5-f4dd-43cf-82e3-0b8dc9fe1870+9:13815:x1853164331484544:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 30us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316155.163819:0:66742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 128 00000100:00080000:3.0:1767316155.164318:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1767316155.175536:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1767316155.175574:0:66732:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331484672 00000100:00100000:1.0:1767316155.175583:0:66732:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331484672 00000100:00100000:1.0:1767316155.175656:0:66732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 79 00000100:00100000:1.0:1767316155.175667:0:66732:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a402f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+7:13816:x1853164331484672:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1767316155.175737:0:66732:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a402f5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+7:13816:x1853164331484672:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.175745:0:66732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 79 00000100:00080000:1.0:1767316155.175766:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0F:1767316155.286578:0:46026:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767316155.607162:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a402f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419071744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1767316155.607227:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316155.607316:0:44074:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419071744 00000100:00100000:3.0:1767316155.607323:0:44074:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419071744 00000100:00100000:3.0:1767316155.607365:0:44074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1767316155.607381:0:44074:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5353c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:32737:x1853164419071744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1767316155.607416:0:44074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 218353664 avail 191328256 00000100:00100000:3.0:1767316155.607480:0:44074:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5353c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:32737:x1853164419071744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316155.607488:0:44074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1767316155.607534:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a402f5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419071744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1767316155.608764:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5353c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e43490ac-1d2e-4c4a-8c39-a2dc980ac0a3:32738:1853164419071872:0@lo:400:kworker.0 00000100:00100000:3.0:1767316155.608818:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316155.608855:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5353c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:32738:1853164419072384:0@lo:400:kworker.0 00000100:00100000:3.0:1767316155.608882:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316155.608898:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40a4b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:32738:1853164419072896:0@lo:400:kworker.0 00000100:00100000:3.0:1767316155.608935:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316155.610821:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5353c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:32740:1853164419072128:0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.612683:0:66741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419071872 00000100:00100000:1.0:1767316155.612697:0:66741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419071872 00000100:00100000:1.0:1767316155.612753:0:66741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1767316155.612762:0:66741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40b1ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e43490ac-1d2e-4c4a-8c39-a2dc980ac0a3+23:32738:x1853164419071872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.612835:0:66741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40b1ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e43490ac-1d2e-4c4a-8c39-a2dc980ac0a3+23:32738:x1853164419071872:12345-0@lo:400:kworker.0 Request processed in 73us (4016us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.612842:0:66741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1767316155.613063:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316155.613097:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40a4b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419072640:0@lo:400:kworker.0 00000100:00100000:2.0:1767316155.613130:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316155.613148:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40a4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419073152:0@lo:400:kworker.0 00000100:00100000:2.0:1767316155.613167:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316155.613188:0:32740:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1767316155.613194:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5353c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:32740:1853164419072000:0@lo:400:kworker.0 00000100:00100000:2.0:1767316155.613214:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316155.613230:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5353c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419072512:0@lo:400:kworker.0 00000100:00100000:2.0:1767316155.613260:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316155.613279:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40a4b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419073024:0@lo:400:kworker.0 00000100:00100000:2.0:1767316155.613298:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316155.613330:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5353c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:32737:1853164419072256:0@lo:400:kworker.0 00000100:00100000:2.0:1767316155.613353:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316155.613369:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40a4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:32737:1853164419072768:0@lo:400:kworker.0 00000100:00100000:2.0:1767316155.613388:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316155.613404:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40a4b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:32737:1853164419073280:0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.613412:0:66733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419072384 00000100:00100000:1.0:1767316155.613418:0:66733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419072384 00000100:00100000:2.0:1767316155.613424:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316155.614115:0:66733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419072128 00000100:00100000:1.0:1767316155.614129:0:66733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419072128 00000100:00100000:1.0:1767316155.614147:0:66733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419072000 00000100:00100000:1.0:1767316155.614149:0:66733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419072000 00000100:00100000:1.0:1767316155.614161:0:66733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419072256 00000100:00100000:1.0:1767316155.614164:0:66733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419072256 00000100:00100000:1.0:1767316155.614174:0:66733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419072768 00000100:00100000:1.0:1767316155.614176:0:66733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419072768 00000100:00100000:1.0:1767316155.614186:0:66733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419073280 00000100:00100000:1.0:1767316155.614188:0:66733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419073280 00000100:00100000:1.0:1767316155.614201:0:66733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1767316155.614209:0:66733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40a4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:32738:x1853164419072384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.614277:0:66733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40a4b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:32738:x1853164419072384:12345-0@lo:400:kworker.0 Request processed in 70us (5394us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.614284:0:66733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1767316155.614298:0:66733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1767316155.614303:0:66733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a539b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:32740:x1853164419072128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.614427:0:66733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a539b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:32740:x1853164419072128:12345-0@lo:400:kworker.0 Request processed in 122us (1363us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.614434:0:66733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1767316155.614594:0:66733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1767316155.614601:0:66733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a539b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:32740:x1853164419072000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.614635:0:66733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a539b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:32740:x1853164419072000:12345-0@lo:400:kworker.0 Request processed in 35us (1420us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.614641:0:66733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1767316155.614652:0:66733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1767316155.614659:0:66733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a539b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:32737:x1853164419072256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.614685:0:66733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a539b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:32737:x1853164419072256:12345-0@lo:400:kworker.0 Request processed in 28us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.614698:0:66733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1767316155.614710:0:66733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1767316155.614716:0:66733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a539b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:32737:x1853164419072768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.614743:0:66733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a539b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:32737:x1853164419072768:12345-0@lo:400:kworker.0 Request processed in 27us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.614749:0:66733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1767316155.614761:0:66733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1767316155.614767:0:66733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a539b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:32737:x1853164419073280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.614792:0:66733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a539b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:32737:x1853164419073280:12345-0@lo:400:kworker.0 Request processed in 26us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.614797:0:66733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1767316155.615383:0:44063:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419072640 00000100:00100000:1.0:1767316155.615391:0:44063:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419072640 00000100:00100000:1.0:1767316155.615432:0:44063:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419073152 00000100:00100000:1.0:1767316155.615435:0:44063:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419073152 00000100:00100000:1.0:1767316155.615482:0:44063:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419072512 00000100:00100000:1.0:1767316155.615486:0:44063:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419072512 00000100:00100000:1.0:1767316155.615505:0:44063:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419073024 00000100:00100000:1.0:1767316155.615508:0:44063:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419073024 00000100:00100000:1.0:1767316155.615527:0:44063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1767316155.615534:0:44063:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a539b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:32740:x1853164419072640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.615579:0:44063:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a539b5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:32740:x1853164419072640:12345-0@lo:400:kworker.0 Request processed in 46us (2448us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.615584:0:44063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1767316155.615596:0:44063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1767316155.615601:0:44063:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a539b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:32740:x1853164419073152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.615637:0:44063:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a539b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:32740:x1853164419073152:12345-0@lo:400:kworker.0 Request processed in 36us (2469us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.615642:0:44063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1767316155.615652:0:44063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1767316155.615661:0:44063:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a539b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:32740:x1853164419072512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.615689:0:44063:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a539b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:32740:x1853164419072512:12345-0@lo:400:kworker.0 Request processed in 32us (2429us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.615694:0:44063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1767316155.615703:0:44063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1767316155.615708:0:44063:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a539b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:32740:x1853164419073024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.615731:0:44063:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a539b5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:32740:x1853164419073024:12345-0@lo:400:kworker.0 Request processed in 23us (2432us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.615736:0:44063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00080000:1.0:1767316155.615753:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1767316155.615763:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1767316155.615765:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1767316155.615768:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1767316155.615816:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5353c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:32740:1853164419072000:0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.615827:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5353c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419072512:0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.615836:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40a4b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419073024:0@lo:400:kworker.0 00000100:00100000:3.0:1767316155.616234:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5353c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e43490ac-1d2e-4c4a-8c39-a2dc980ac0a3:32738:1853164419071872:0@lo:400:kworker.0 00000100:00100000:3.0:1767316155.616262:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5353c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:32738:1853164419072384:0@lo:400:kworker.0 00000100:00100000:3.0:1767316155.616294:0:44073:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419072896 00000100:00100000:3.0:1767316155.616298:0:44073:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419072896 00000100:00100000:3.0:1767316155.616328:0:44073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1767316155.616334:0:44073:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40a4b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:32738:x1853164419072896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1767316155.616379:0:44073:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40a4b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:32738:x1853164419072896:12345-0@lo:400:kworker.0 Request processed in 44us (7443us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316155.616386:0:44073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1767316155.616420:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40a4b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:32738:1853164419072896:0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.617551:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5353c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:32740:1853164419072128:0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.617579:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40a4b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419072640:0@lo:400:kworker.0 00000100:00100000:1.0:1767316155.617590:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40a4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419073152:0@lo:400:kworker.0 00000100:00100000:2.0:1767316155.618723:0:32737:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767316155.618749:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a51079aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:32737:1853164419073408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1767316155.618811:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316155.618920:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5353c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:32737:1853164419072256:0@lo:400:kworker.0 00000100:00100000:2.0:1767316155.618935:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40a4b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:32737:1853164419072768:0@lo:400:kworker.0 00000100:00100000:3.0:1767316155.618961:0:44074:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419073408 00000100:00100000:2.0:1767316155.618968:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40a4b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:32737:1853164419073280:0@lo:400:kworker.0 00000100:00100000:3.0:1767316155.618971:0:44074:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419073408 00000100:00100000:3.0:1767316155.619010:0:44074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1767316155.619018:0:44074:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a539b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:32737:x1853164419073408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1767316155.619184:0:44074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 218476544 avail 191451136 00000100:00100000:3.0:1767316155.619255:0:44074:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a539b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:32737:x1853164419073408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 222us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316155.619263:0:44074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1767316155.619286:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a51079aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:32737:1853164419073408:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1767316155.626461:0:70169:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-scrub test 4a: Auto trigger OI scrub if bad OI mapping was found (1) ========================================================== 20:09:14 (1767316154) 00000100:00100000:3.0:1767316155.717308:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316155.717498:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331485184 00000100:00100000:0.0:1767316155.717508:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331485184 00000100:00100000:0.0:1767316155.717565:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 272 00000100:00100000:0.0:1767316155.717574:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40a4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+7:32036:x1853164331485184:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:0.0:1767316155.717824:0:66756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1767316155.717845:0:66756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac600/0x1c4382d255f6fa25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37ef50 expref: -99 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.718050:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa2c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718064:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718076:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718088:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa33 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718095:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718116:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718166:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac800/0x1c4382d255f6fa3a lrc: 3/1,0 mode: --/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718174:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac800/0x1c4382d255f6fa3a lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718180:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac800/0x1c4382d255f6fa3a lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT0 00000004:00200000:0.0:1767316155.718212:0:66756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200001b72:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1767316155.718215:0:66756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1767316155.718232:0:66756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac800/0x1c4382d255f6fa3a lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718252:0:66756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa2c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718259:0:66756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa2c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718265:0:66756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718271:0:66756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52aaad200 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:0.0:1767316155.718275:0:66756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa2c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718281:0:66756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa2c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718292:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a537f05f00) 00010000:00010000:0.0:1767316155.718300:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316155.718306:0:66756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718312:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718324:0:66756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa33 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718329:0:66756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa33 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718334:0:66756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718339:0:66756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52aaad600 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:0.0:1767316155.718342:0:66756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa33 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718347:0:66756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa33 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718353:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x31d62d73 (ffff93a505285900) 00010000:00010000:0.0:1767316155.718355:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316155.718357:0:66756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa33 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718362:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa33 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.718390:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac600/0x1c4382d255f6fa25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef50 expref: 9 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.718414:0:66756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac800/0x1c4382d255f6fa3a lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef50 expref: 8 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.718420:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:0.0:1767316155.718422:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1767316155.718424:0:66756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52aaac800, rc 0) 00000100:00100000:0.0:1767316155.718516:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40a4b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+8:32036:x1853164331485184:12345-192.168.203.1@tcp:101:rm.0 Request processed in 943us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316155.718525:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 272 00000100:00100000:1.0:1767316155.732118:0:32732:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1767316155.732182:0:66736:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331485312 00000100:00100000:2.0:1767316155.732192:0:66736:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331485312 00000100:00100000:2.0:1767316155.732254:0:66736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 22 00000100:00100000:2.0:1767316155.732264:0:66736:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a402f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:32036:x1853164331485312:12345-192.168.203.1@tcp:37:rm.0 00000100:00100000:0.0:1767316155.739954:0:66736:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a402f5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:32036:x1853164331485312:12345-192.168.203.1@tcp:37:rm.0 Request processed in 7680us (7830us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316155.739968:0:66736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 22 00000100:00100000:1.0:1767316155.752218:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316155.752951:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331485440 00000100:00100000:0.0:1767316155.752963:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331485440 00000100:00100000:0.0:1767316155.753065:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 273 00000100:00100000:0.0:1767316155.753075:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a402f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+8:32036:x1853164331485440:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:0.0:1767316155.753097:0:66756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1767316155.753116:0:66756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac600/0x1c4382d255f6fa41 lrc: 2/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37ef57 expref: -99 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.753178:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa48 lrc: 3/1,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753192:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa48 lrc: 3/1,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753203:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa48 lrc: 3/1,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753227:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa4f lrc: 3/1,0 mode: --/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753234:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa4f lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753250:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa4f lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753307:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fa56 lrc: 3/1,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753314:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fa56 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753321:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fa56 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT0 00000004:00010000:0.0:1767316155.753340:0:66756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fa56 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753351:0:66756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa48 lrc: 3/1,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753357:0:66756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa48 lrc: 2/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753362:0:66756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa48 lrc: 3/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753369:0:66756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52aaad600 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:0.0:1767316155.753373:0:66756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa48 lrc: 3/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753389:0:66756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa48 lrc: 4/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753403:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:0.0:1767316155.753406:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316155.753411:0:66756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa48 lrc: 2/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753417:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad600/0x1c4382d255f6fa48 lrc: 0/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753467:0:66756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa4f lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753474:0:66756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa4f lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753479:0:66756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa4f lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753484:0:66756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52aaad200 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:0.0:1767316155.753487:0:66756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa4f lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753493:0:66756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa4f lrc: 4/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753500:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0xc4959c6c (ffff93a505285900) 00010000:00010000:0.0:1767316155.753502:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316155.753505:0:66756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa4f lrc: 2/0,0 mode: --/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753510:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa4f lrc: 0/0,0 mode: --/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.753548:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac600/0x1c4382d255f6fa41 lrc: 0/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef57 expref: 10 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.753562:0:66756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fa56 lrc: 3/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef57 expref: 9 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.753569:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285b00) 00010000:00010000:0.0:1767316155.753571:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1767316155.753573:0:66756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52aaad400, rc 0) 00000100:00100000:0.0:1767316155.754790:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a402f5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+9:32036:x1853164331485440:12345-192.168.203.1@tcp:101:rm.0 Request processed in 1709us (2574us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316155.754801:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 273 00000100:00100000:0.0:1767316155.766480:0:32732:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316155.766513:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331485568 00000100:00100000:0.0:1767316155.766522:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331485568 00000100:00100000:0.0:1767316155.766572:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 274 00000100:00100000:0.0:1767316155.766582:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a51079bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+5:32036:x1853164331485568:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:0.0:1767316155.766611:0:66756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1767316155.766637:0:66756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fa5d lrc: 2/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37ef5e expref: -99 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.766703:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad800/0x1c4382d255f6fa64 lrc: 3/1,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316155.766716:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad800/0x1c4382d255f6fa64 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316155.766729:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad800/0x1c4382d255f6fa64 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT1 00000004:00200000:0.0:1767316155.766780:0:66756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1767316155.766784:0:66756:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1767316155.766817:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fa5d lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef5e expref: 7 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.766833:0:66756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad800/0x1c4382d255f6fa64 lrc: 3/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef5e expref: 6 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.766842:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285200) 00010000:00010000:0.0:1767316155.766845:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1767316155.766858:0:66756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52aaad800, rc 0) 00000100:00100000:0.0:1767316155.766911:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a51079bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+6:32036:x1853164331485568:12345-192.168.203.1@tcp:101:rm.0 Request processed in 331us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316155.766919:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 274 00000100:00100000:0.0:1767316155.799038:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1767316155.802518:0:66735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331485824 00000100:00100000:3.0:1767316155.802532:0:66735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331485824 00000100:00100000:3.0:1767316155.802602:0:66735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 275 00000100:00100000:3.0:1767316155.802612:0:66735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a510799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+6:32036:x1853164331485824:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:3.0:1767316155.802630:0:66735:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1767316155.802667:0:66735:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1a00/0x1c4382d255f6fa6b lrc: 2/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37ef65 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.802761:0:66735:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1600/0x1c4382d255f6fa72 lrc: 3/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66735 initiator: MDT0 00010000:00010000:3.0:1767316155.802775:0:66735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1600/0x1c4382d255f6fa72 lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66735 initiator: MDT1 00010000:00010000:3.0:1767316155.802785:0:66735:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1600/0x1c4382d255f6fa72 lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66735 initiator: MDT1 00000004:00200000:3.0:1767316155.802795:0:66735:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1767316155.802890:0:66735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1a00/0x1c4382d255f6fa6b lrc: 0/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef65 expref: 9 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.802910:0:66735:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1600/0x1c4382d255f6fa72 lrc: 3/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef65 expref: 8 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.802930:0:66735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285200) 00010000:00010000:3.0:1767316155.802933:0:66735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1767316155.802936:0:66735:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a5313e1600, rc 0) 00000100:00100000:3.0:1767316155.802998:0:66735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a510799f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+8:32036:x1853164331485824:12345-192.168.203.1@tcp:101:rm.0 Request processed in 388us (3970us total) trans 17179869278 rc 0/0 00000100:00100000:3.0:1767316155.803006:0:66735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 275 00000100:00100000:3.0:1767316155.815888:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316155.816111:0:66736:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331485952 00000100:00100000:0.0:1767316155.816121:0:66736:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331485952 00000100:00100000:0.0:1767316155.816272:0:66736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 23 00000100:00100000:0.0:1767316155.816283:0:66736:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40a4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:32036:x1853164331485952:12345-192.168.203.1@tcp:37:rm.0 00000100:00100000:0.0:1767316155.824371:0:66736:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40a4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:32036:x1853164331485952:12345-192.168.203.1@tcp:37:rm.0 Request processed in 8080us (8480us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316155.824384:0:66736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 23 00000100:00100000:0.0:1767316155.832021:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1767316155.832162:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331486080 00000100:00100000:2.0:1767316155.832186:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331486080 00000100:00100000:2.0:1767316155.832251:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 276 00000100:00100000:2.0:1767316155.832262:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a51079aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+9:32036:x1853164331486080:12345-192.168.203.1@tcp:41:rm.0 00000004:00000024:2.0:1767316155.832314:0:66756:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 638038016 avail 582414336 00000100:00100000:2.0:1767316155.832384:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a51079aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+9:32036:x1853164331486080:12345-192.168.203.1@tcp:41:rm.0 Request processed in 123us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316155.832392:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 276 00000100:00100000:1.0:1767316155.836805:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1767316155.836894:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331486208 00000100:00100000:2.0:1767316155.836903:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331486208 00000100:00100000:2.0:1767316155.836966:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 277 00000100:00100000:2.0:1767316155.836977:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a402f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+8:32036:x1853164331486208:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:2.0:1767316155.836996:0:66756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1767316155.837016:0:66756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1e000/0x1c4382d255f6fa80 lrc: 2/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37ef6c expref: -99 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.837074:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1ee00/0x1c4382d255f6fa87 lrc: 3/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:2.0:1767316155.837088:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1ee00/0x1c4382d255f6fa87 lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837112:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1ee00/0x1c4382d255f6fa87 lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837127:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fa8e lrc: 3/1,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:2.0:1767316155.837134:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fa8e lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837140:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fa8e lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837346:0:66756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1ee00/0x1c4382d255f6fa87 lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837354:0:66756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1ee00/0x1c4382d255f6fa87 lrc: 2/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837360:0:66756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1ee00/0x1c4382d255f6fa87 lrc: 3/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837366:0:66756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52cb1ee00 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:2.0:1767316155.837370:0:66756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1ee00/0x1c4382d255f6fa87 lrc: 3/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837377:0:66756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1ee00/0x1c4382d255f6fa87 lrc: 4/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837388:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285200) 00010000:00010000:2.0:1767316155.837391:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1767316155.837395:0:66756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1ee00/0x1c4382d255f6fa87 lrc: 2/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837400:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1ee00/0x1c4382d255f6fa87 lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837415:0:66756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fa8e lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837420:0:66756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fa8e lrc: 2/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837426:0:66756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fa8e lrc: 3/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837626:0:66756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52cb1e800 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:2.0:1767316155.837630:0:66756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fa8e lrc: 3/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837637:0:66756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fa8e lrc: 4/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837732:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0xd49b5cf7 (ffff93a51066ed00) 00010000:00010000:2.0:1767316155.837736:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1767316155.837740:0:66756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fa8e lrc: 2/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837746:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fa8e lrc: 0/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT1 00010000:00010000:2.0:1767316155.837778:0:66756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1e000/0x1c4382d255f6fa80 lrc: 1/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef6c expref: 9 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.837788:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285200) 00010000:00010000:2.0:1767316155.837790:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1767316155.837794:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52cb1e000/0x1c4382d255f6fa80 lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef6c expref: 9 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.837814:0:66756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52cb1e000, rc 0) 00000100:00100000:2.0:1767316155.837901:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a402f5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+8:32036:x1853164331486208:12345-192.168.203.1@tcp:101:rm.0 Request processed in 925us (1102us total) trans 0 rc 301/301 00000100:00100000:2.0:1767316155.837909:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 277 00000100:00100000:1.0:1767316155.843338:0:32732:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1767316155.843383:0:32732:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1767316155.843498:0:66736:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331486592 00000100:00100000:2.0:1767316155.843508:0:66736:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331486592 00000100:00100000:2.0:1767316155.843550:0:66736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:2.0:1767316155.843560:0:66736:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5314b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:32036:x1853164331486592:12345-192.168.203.1@tcp:35:rm.0 00000100:00100000:2.0:1767316155.843770:0:66736:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5314b1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+9:32036:x1853164331486592:12345-192.168.203.1@tcp:35:rm.0 Request processed in 211us (386us total) trans 17179869279 rc 0/0 00000100:00100000:2.0:1767316155.843778:0:66736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 24 00000100:00100000:0.0:1767316155.843915:0:41155:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331486336 00000100:00100000:0.0:1767316155.843920:0:41155:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331486336 00000100:00100000:0.0:1767316155.843960:0:41155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 73 00000100:00100000:0.0:1767316155.843969:0:41155:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a402f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+9:13816:x1853164331486336:12345-192.168.203.1@tcp:103:rm.0 00010000:00010000:0.0:1767316155.843993:0:41155:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1767316155.844017:0:41155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fa56 lrc: 0/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef57 expref: 9 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.844034:0:41155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285b00) 00010000:00010000:0.0:1767316155.844045:0:41155:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1767316155.844067:0:41155:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a402f5f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:13816:x1853164331486336:12345-192.168.203.1@tcp:103:rm.0 Request processed in 99us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316155.844075:0:41155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 73 00000100:00100000:0.0:1767316155.846686:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1767316155.846859:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331486848 00000100:00100000:2.0:1767316155.846869:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331486848 00000100:00100000:3.0:1767316155.847027:0:66735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 278 00000100:00100000:3.0:1767316155.847039:0:66735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a510798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+9:32036:x1853164331486848:12345-192.168.203.1@tcp:36:rm.0 00010000:00010000:3.0:1767316155.847093:0:66735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1767316155.847118:0:66735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1600/0x1c4382d255f6fa72 lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef65 expref: 9 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.847137:0:66735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad800/0x1c4382d255f6fa64 lrc: 0/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef5e expref: 8 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.847148:0:66735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285200) 00010000:00010000:3.0:1767316155.847158:0:66735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1767316155.847206:0:66735:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 3/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66735 initiator: MDT0 00010000:00010000:3.0:1767316155.847213:0:66735:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 3/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66735 initiator: MDT1 00010000:00010000:3.0:1767316155.847222:0:66735:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 3/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66735 initiator: MDT1 00000100:00100000:3.0:1767316155.847253:0:66735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40a4b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66735:1853164419073536:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1767316155.847309:0:66735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316155.847342:0:66735:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a505746300 going to sleep for 11 seconds 00000100:00100000:0.0:1767316155.848512:0:44073:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419073536 00000100:00100000:0.0:1767316155.848523:0:44073:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419073536 00000100:00100000:0.0:1767316155.848568:0:44073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1767316155.848575:0:44073:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40a4b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66735:x1853164419073536:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1767316155.848588:0:44073:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1767316155.848602:0:44073:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa9c lrc: 2/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c4382d255f6fa95 expref: -99 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.848627:0:44073:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac800/0x1c4382d255f6fa3a lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef50 expref: 7 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.848637:0:44073:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa9c lrc: 4/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1c4382d255f6fa95 expref: 7 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.848663:0:44073:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac800/0x1c4382d255f6fa3a lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef50 expref: 7 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.848674:0:44073:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac800/0x1c4382d255f6fa3a lrc: 4/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef50 expref: 7 pid: 66756 timeout: 1458 lvb_type: 0 00000100:00100000:0.0:1767316155.848698:0:44073:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a510799180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:44073:1853164419073664:192.168.203.1@tcp:104: 00000100:00100000:0.0:1767316155.848768:0:44073:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a503fabe40 going to sleep for 11 seconds 00000100:00100000:1.0:1767316155.853865:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316155.854038:0:44073:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a510799180 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:44073:1853164419073664:192.168.203.1@tcp:104: 00010000:00010000:0.0:1767316155.854070:0:44073:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa9c lrc: 3/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6fa95 expref: 7 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.854083:0:44073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:0.0:1767316155.854085:0:44073:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316155.854089:0:44073:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa9c lrc: 3/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6fa95 expref: 7 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.854098:0:44073:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52aaad200, rc 0) 00000100:00100000:0.0:1767316155.854156:0:44073:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40a4b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66735:x1853164419073536:12345-0@lo:101:mdt00_002.0 Request processed in 5580us (6844us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316155.854165:0:44073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1767316155.854189:0:66735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40a4b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66735:1853164419073536:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1767316155.854209:0:66735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 4/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.854219:0:66735:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 4/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1767316155.854274:0:41155:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331486976 00000100:00100000:2.0:1767316155.854282:0:41155:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331486976 00010000:00010000:2.0:1767316155.854312:0:41155:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac800/0x1c4382d255f6fa3a lrc: 4/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef50 expref: 8 pid: 66756 timeout: 1458 lvb_type: 0 00000100:00100000:2.0:1767316155.854340:0:41155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 868 00000100:00100000:2.0:1767316155.854348:0:41155:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a402f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:13817:x1853164331486976:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1767316155.854362:0:41155:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1767316155.854368:0:41155:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac800/0x1c4382d255f6fa3a lrc: 4/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef50 expref: 8 pid: 66756 timeout: 1458 lvb_type: 0 00010000:00010000:2.0:1767316155.854378:0:41155:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac800/0x1c4382d255f6fa3a lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef50 expref: 8 pid: 66756 timeout: 1458 lvb_type: 0 00010000:00010000:2.0:1767316155.854415:0:41155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac800/0x1c4382d255f6fa3a lrc: 0/0,0 mode: --/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef50 expref: 8 pid: 66756 timeout: 1458 lvb_type: 0 00010000:00010000:2.0:1767316155.854427:0:41155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:2.0:1767316155.854469:0:41155:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa9c lrc: 2/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6fa95 expref: 6 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.854479:0:41155:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa9c lrc: 2/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1c4382d255f6fa95 expref: 6 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.854487:0:41155:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa9c lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 0@lo remote: 0x1c4382d255f6fa95 expref: 6 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.854519:0:41155:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa9c lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6fa95 expref: 6 pid: 44073 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1767316155.854531:0:41155:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a539b5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:41155:1853164419073792:0@lo:105: 00000100:00100000:2.0:1767316155.854567:0:41155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316155.854598:0:41155:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a50a60c780 going to sleep for 11 seconds 00000100:00100000:0.0:1767316155.854844:0:41154:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419073792 00000100:00100000:0.0:1767316155.854850:0:41154:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419073792 00000100:00100000:0.0:1767316155.854886:0:41154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1767316155.854893:0:41154:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a539b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:41155:x1853164419073792:12345-0@lo:105: 00010000:00010000:0.0:1767316155.854903:0:41154:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 5/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.854922:0:41154:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 5/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.854930:0:41154:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 5/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.854945:0:41154:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 5/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.854951:0:41154:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 6/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.854961:0:41154:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 6/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.854980:0:41154:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff93a5313e1200) 00010000:00010000:3.0:1767316155.855000:0:66735:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 4/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.855011:0:66735:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 4/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1767316155.855024:0:41154:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a539b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:41155:x1853164419073792:12345-0@lo:105: Request processed in 131us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316155.855031:0:41154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000004:00080000:3.0:1767316155.855034:0:66735:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200001b72:0x1:0x0] 00010000:00010000:3.0:1767316155.855064:0:66735:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 3/0,1 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66735 initiator: MDT0 00010000:00010000:3.0:1767316155.855071:0:66735:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 3/0,1 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66735 initiator: MDT1 00010000:00010000:3.0:1767316155.855080:0:66735:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 3/0,1 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66735 initiator: MDT1 00000100:00100000:3.0:1767316155.855094:0:66735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40a4b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66735:1853164419073920:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1767316155.855120:0:66735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316155.855147:0:66735:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a505746300 going to sleep for 11 seconds 00000100:00100000:0.0:1767316155.855192:0:44073:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419073920 00000100:00100000:0.0:1767316155.855197:0:44073:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419073920 00000100:00100000:0.0:1767316155.855224:0:44073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1767316155.855230:0:44073:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40a4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66735:x1853164419073920:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1767316155.855254:0:44073:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1767316155.855267:0:44073:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6faaa lrc: 2/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c4382d255f6faa3 expref: -99 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.855285:0:44073:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6faaa lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1c4382d255f6faa3 expref: 8 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.855295:0:44073:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6faaa lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6faa3 expref: 8 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.855301:0:44073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0xc4959c6c (ffff93a505285b00) 00010000:00010000:0.0:1767316155.855309:0:44073:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316155.855312:0:44073:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52aaad400, rc 0) 00000100:00100000:0.0:1767316155.855346:0:44073:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40a4b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66735:x1853164419073920:12345-0@lo:101:mdt00_002.0 Request processed in 115us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316155.855352:0:44073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1767316155.855374:0:66735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40a4b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66735:1853164419073920:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1767316155.855387:0:66735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 4/0,1 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1c4382d255f6faaa expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.855403:0:66735:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 4/0,1 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6faaa expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1767316155.855415:0:66735:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200001b72:0x1:0x0] 00000100:00100000:2.0:1767316155.855427:0:41155:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a539b5f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:41155:1853164419073792:0@lo:105: 00010000:00010000:2.0:1767316155.855479:0:41155:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1767316155.855516:0:41155:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a402f5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+7:13817:x1853164331486976:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 1167us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316155.855523:0:41155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 868 00000100:00100000:3.0:1767316155.855815:0:66735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40a4b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66735:1853164419074048:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1767316155.855841:0:66735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316155.855866:0:66735:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a505746240 going to sleep for 11 seconds 00000100:00100000:0.0:1767316155.855901:0:44073:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419074048 00000100:00100000:0.0:1767316155.855916:0:44073:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419074048 00000100:00100000:0.0:1767316155.855945:0:44073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1767316155.855952:0:44073:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40a4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66735:x1853164419074048:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1767316155.856014:0:44073:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40a4b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66735:x1853164419074048:12345-0@lo:1000:mdt00_002.0 Request processed in 62us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316155.856023:0:44073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1767316155.856037:0:66735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40a4b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66735:1853164419074048:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1767316155.856077:0:66735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40a4b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66735:1853164419074176:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1767316155.856099:0:66735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316155.856117:0:66735:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a505746240 going to sleep for 11 seconds 00000100:00100000:0.0:1767316155.856169:0:44073:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419074176 00000100:00100000:0.0:1767316155.856173:0:44073:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419074176 00000100:00100000:0.0:1767316155.856197:0:44073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1767316155.856205:0:44073:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40a4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66735:x1853164419074176:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1767316155.856284:0:44073:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40a4b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66735:x1853164419074176:12345-0@lo:1000:mdt00_002.0 Request processed in 80us (184us total) trans 0 rc 1/1 00000100:00100000:0.0:1767316155.856292:0:44073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1767316155.856308:0:66735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40a4b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66735:1853164419074176:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1767316155.856351:0:66735:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 3/0,1 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66735 initiator: MDT0 00010000:00010000:3.0:1767316155.856360:0:66735:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 3/0,1 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66735 initiator: MDT1 00010000:00010000:3.0:1767316155.856367:0:66735:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 3/0,1 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66735 initiator: MDT1 00000100:00100000:3.0:1767316155.856378:0:66735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40a4b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66735:1853164419074304:0@lo:101:mdt00_002.0 00000100:00100000:3.0:1767316155.856400:0:66735:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316155.856420:0:66735:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a505746300 going to sleep for 11 seconds 00000100:00100000:0.0:1767316155.856872:0:44073:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419074304 00000100:00100000:0.0:1767316155.856878:0:44073:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419074304 00000100:00100000:0.0:1767316155.857057:0:44073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1767316155.857067:0:44073:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40a4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66735:x1853164419074304:12345-0@lo:101:mdt00_002.0 00010000:00010000:0.0:1767316155.857079:0:44073:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1767316155.857095:0:44073:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac000/0x1c4382d255f6fab8 lrc: 2/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c4382d255f6fab1 expref: -99 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.857115:0:44073:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac000/0x1c4382d255f6fab8 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1c4382d255f6fab1 expref: 9 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.857141:0:44073:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac000/0x1c4382d255f6fab8 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6fab1 expref: 9 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.857150:0:44073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285900) 00010000:00010000:0.0:1767316155.857152:0:44073:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1767316155.857156:0:44073:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52aaac000, rc 0) 00000100:00100000:0.0:1767316155.857210:0:44073:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40a4b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66735:x1853164419074304:12345-0@lo:101:mdt00_002.0 Request processed in 144us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316155.857216:0:44073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1767316155.857222:0:66735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40a4b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-mdtlov_UUID:66735:1853164419074304:0@lo:101:mdt00_002.0 00010000:00010000:3.0:1767316155.857248:0:66735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 4/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1c4382d255f6fab8 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.857269:0:66735:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 4/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fab8 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.857294:0:66735:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0c00/0x1c4382d255f6fabf lrc: 3/0,1 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66735 initiator: MDT0 00010000:00010000:3.0:1767316155.857302:0:66735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0c00/0x1c4382d255f6fabf lrc: 3/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66735 initiator: MDT1 00010000:00010000:3.0:1767316155.857309:0:66735:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0c00/0x1c4382d255f6fabf lrc: 3/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66735 initiator: MDT1 00010000:00010000:3.0:1767316155.857389:0:66735:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0c00/0x1c4382d255f6fabf lrc: 3/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66735 initiator: MDT1 00010000:00010000:3.0:1767316155.857396:0:66735:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0c00/0x1c4382d255f6fabf lrc: 2/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66735 initiator: MDT1 00010000:00010000:3.0:1767316155.857402:0:66735:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0c00/0x1c4382d255f6fabf lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66735 initiator: MDT1 00010000:00010000:3.0:1767316155.857408:0:66735:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a5313e0c00 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:3.0:1767316155.857411:0:66735:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0c00/0x1c4382d255f6fabf lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66735 initiator: MDT1 00010000:00010000:3.0:1767316155.857417:0:66735:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0c00/0x1c4382d255f6fabf lrc: 4/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66735 initiator: MDT1 00010000:00010000:3.0:1767316155.857426:0:66735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a511516a00) 00010000:00010000:3.0:1767316155.857429:0:66735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1767316155.857432:0:66735:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0c00/0x1c4382d255f6fabf lrc: 2/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66735 initiator: MDT1 00010000:00010000:3.0:1767316155.857488:0:66735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0c00/0x1c4382d255f6fabf lrc: 0/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66735 initiator: MDT1 00010000:00010000:3.0:1767316155.857506:0:66735:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 4/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fab8 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.857514:0:66735:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 4/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fab8 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.857520:0:66735:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fab8 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.857545:0:66735:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1767316155.857555:0:66735:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200001b72:0x1:0x0] 00010000:00010000:3.0:1767316155.857560:0:66735:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 4/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.857567:0:66735:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 4/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.857574:0:66735:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.857603:0:66735:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1767316155.857608:0:66735:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200001b72:0x1:0x0] 00010000:00010000:3.0:1767316155.857612:0:66735:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 4/0,1 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6faaa expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.857619:0:66735:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 4/0,1 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6faaa expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.857634:0:66735:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6faaa expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316155.857646:0:66735:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1767316155.857700:0:66735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a510798a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+7:32036:x1853164331486848:12345-192.168.203.1@tcp:36:rm.0 Request processed in 10663us (11021us total) trans 0 rc -39/-39 00000100:00100000:3.0:1767316155.857706:0:66735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 278 00010000:00010000:0.0:1767316155.857757:0:46026:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1767316155.857764:0:46026:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 2/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1c4382d255f6fab8 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.857771:0:46026:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a5313e1600 already unused, calling callback (ffffffffc17e9290) 00010000:00010000:0.0:1767316155.857776:0:46026:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1c4382d255f6fab8 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1767316155.857783:0:46026:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1c4382d255f6fab8 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.857806:0:46026:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 2/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fab8 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.857812:0:46026:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316155.857837:0:46026:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 1/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fab8 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.857844:0:46026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1600/0x1c4382d255f6fab1 lrc: 0/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fab8 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.857895:0:41159:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1767316155.857902:0:41159:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 2/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.857917:0:41159:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a5313e1200 already unused, calling callback (ffffffffc17e9290) 00010000:00010000:2.0:1767316155.857921:0:41159:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1767316155.857928:0:41159:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.857946:0:41159:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 2/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.857952:0:41159:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1767316155.857958:0:41159:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 1/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.857965:0:41159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1200/0x1c4382d255f6fa95 lrc: 0/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fa9c expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.857977:0:41159:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1767316155.857980:0:41159:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 2/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1c4382d255f6faaa expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.857985:0:41159:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a5313e1a00 already unused, calling callback (ffffffffc17e9290) 00010000:00010000:2.0:1767316155.857988:0:41159:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1c4382d255f6faaa expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1767316155.857994:0:41159:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1c4382d255f6faaa expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.858007:0:41159:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 2/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6faaa expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.858019:0:41159:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316155.858034:0:41158:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316155.858038:0:41159:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 1/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6faaa expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.858046:0:41159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e1a00/0x1c4382d255f6faa3 lrc: 0/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6faaa expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316155.858050:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a539b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419074560:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1767316155.858062:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316155.858066:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316155.858068:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1767316155.858080:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a539b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419074688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1767316155.858095:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316155.858142:0:32739:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a510799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:32739:1853164419074432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1767316155.858148:0:46026:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316155.858152:0:46026:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316155.858154:0:46026:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316155.858268:0:41155:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419074560 00000100:00100000:1.0:1767316155.858273:0:41155:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419074560 00000100:00100000:1.0:1767316155.858345:0:41155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1767316155.858352:0:41155:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a402f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:32740:x1853164419074560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1767316155.858362:0:41155:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1767316155.858377:0:41155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fa9c lrc: 0/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1c4382d255f6fa95 expref: 9 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316155.858389:0:41155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:1.0:1767316155.858393:0:41155:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1767316155.858424:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316155.858467:0:46227:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419074688 00000100:00100000:0.0:1767316155.858472:0:46227:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419074688 00000100:00100000:0.0:1767316155.858499:0:46227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1767316155.858505:0:46227:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a50d8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+9:32737:x1853164419074688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1767316155.858513:0:46227:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1767316155.858523:0:46227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6faaa lrc: 0/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1c4382d255f6faa3 expref: 9 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316155.858532:0:46227:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0xc4959c6c (ffff93a505285b00) 00010000:00010000:0.0:1767316155.858539:0:46227:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1767316155.858962:0:46227:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a50d8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:lustre-MDT0001-mdtlov_UUID+8:32737:x1853164419074688:12345-0@lo:103:ldlm_bl.0 Request processed in 452us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316155.858969:0:46227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1767316155.859373:0:41155:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a402f5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:32740:x1853164419074560:12345-0@lo:103:ldlm_bl.0 Request processed in 1020us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316155.859381:0:41155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1767316155.859392:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a539b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419074688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1767316155.859613:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a539b5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419074560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1767316155.859816:0:32739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316155.859911:0:41155:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419074432 00000100:00100000:2.0:1767316155.859916:0:41155:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419074432 00000100:00100000:2.0:1767316155.859982:0:41155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1767316155.859992:0:41155:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40a4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+7:32739:x1853164419074432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1767316155.860003:0:41155:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1767316155.860019:0:41155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac000/0x1c4382d255f6fab8 lrc: 0/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1c4382d255f6fab1 expref: 7 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316155.860034:0:41155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285900) 00010000:00010000:2.0:1767316155.860042:0:41155:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1767316155.860081:0:41155:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40a4b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+6:32739:x1853164419074432:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316155.860087:0:41155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1767316155.860144:0:32739:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a510799180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:32739:1853164419074432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1767316156.119026:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a539b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:32738:1853164419074816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1767316156.119096:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316156.119186:0:44064:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419074816 00000100:00100000:1.0:1767316156.119195:0:44064:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419074816 00000100:00100000:1.0:1767316156.119257:0:44064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1767316156.119266:0:44064:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a510799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:32738:x1853164419074816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1767316156.119293:0:44064:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8704320 pending 0 free 319000576 avail 291188736 00000100:00100000:3.0:1767316156.119709:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40a4b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419075072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1767316156.119739:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316156.119762:0:32740:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1767316156.119767:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40a4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419074944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1767316156.119787:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316156.119811:0:44065:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419075072 00000100:00100000:3.0:1767316156.119815:0:44065:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419075072 00000100:00100000:3.0:1767316156.119833:0:44065:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419074944 00000100:00100000:3.0:1767316156.119835:0:44065:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419074944 00000100:00100000:3.0:1767316156.119847:0:44065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1767316156.119854:0:44065:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40a4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:32740:x1853164419075072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1767316156.119870:0:44065:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8704320 pending 0 free 319037440 avail 291225600 00000100:00100000:3.0:1767316156.119900:0:44065:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40a4b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:32740:x1853164419075072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316156.119907:0:44065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1767316156.119921:0:44065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1767316156.119934:0:44065:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40a4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:32740:x1853164419074944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1767316156.119944:0:44065:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8704320 pending 0 free 319037440 avail 291225600 00000100:00100000:3.0:1767316156.119966:0:44065:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40a4b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:32740:x1853164419074944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316156.119972:0:44065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1767316156.120008:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40a4b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419074944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1767316156.120021:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40a4b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419075072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1767316156.120166:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a539b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419075200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1767316156.120190:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316156.120219:0:44065:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419075200 00000100:00100000:3.0:1767316156.120223:0:44065:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419075200 00000100:00100000:3.0:1767316156.120249:0:44065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1767316156.120255:0:44065:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40a4b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:32737:x1853164419075200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1767316156.120265:0:44065:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 8704320 pending 0 free 319000576 avail 291188736 00000100:00100000:3.0:1767316156.120296:0:44065:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40a4b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:32737:x1853164419075200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 41us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316156.120303:0:44065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1767316156.120333:0:44064:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a510799180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:32738:x1853164419074816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1065us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316156.120341:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a539b5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419075200:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1767316156.120345:0:44064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1767316156.129551:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a539b5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:32738:1853164419074816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1767316156.311363:0:41158:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316157.338155:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1767316157.361028:0:70217:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-scrub test_4a: @@@@@@ FAIL: Fail to cleanup the env! 00010000:00010000:0.0:1767316158.360786:0:46026:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 675 lines, 675 kept, 0 dropped, 0 bad.