00010000:00010000:3.0F:1767316182.938433:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1767316183.959479:0:46026:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1767316184.812528:0:66726:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869285 is committed 00010000:00010000:2.0F:1767316184.987052:0:41158:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316185.874112:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1767316185.874155:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1767316185.874194:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1767316185.874222:0:66732:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331495424 00000100:00100000:1.0:1767316185.874232:0:66732:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331495424 00000100:00100000:1.0:1767316185.874316:0:66732:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331495552 00000100:00100000:1.0:1767316185.874320:0:66732:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331495552 00000100:00100000:1.0:1767316185.874345:0:66732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 126 00000100:00100000:1.0:1767316185.874354:0:66732:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40e998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+7:13817:x1853164331495424:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1767316185.874429:0:66732:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40e998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+7:13817:x1853164331495424:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 75us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316185.874458:0:66732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 126 00000100:00100000:1.0:1767316185.874476:0:66732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 127 00000100:00100000:1.0:1767316185.874483:0:66732:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40e99ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+5:13816:x1853164331495552:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:1.0:1767316185.874508:0:66732:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40e99ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+5:13816:x1853164331495552:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 26us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316185.874514:0:66732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 127 00000100:00080000:1.0:1767316185.874530:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1767316185.874533:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1767316185.874732:0:66742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331495296 00000100:00100000:2.0:1767316185.874738:0:66742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331495296 00000100:00100000:2.0:1767316185.874774:0:66742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 140 00000100:00100000:2.0:1767316185.874781:0:66742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf5678e5-f4dd-43cf-82e3-0b8dc9fe1870+9:13817:x1853164331495296:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:2.0:1767316185.874817:0:66742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506fe2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf5678e5-f4dd-43cf-82e3-0b8dc9fe1870+9:13817:x1853164331495296:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 37us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316185.874824:0:66742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 140 00010000:00010000:3.0:1767316186.006620:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1767316186.327710:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40e999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:32738:1853164419090816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1767316186.327778:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1767316186.332970:0:44074:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419090816 00000100:00100000:0.0:1767316186.333000:0:44074:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419090816 00000100:00100000:0.0:1767316186.333075:0:44074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1767316186.333085:0:44074:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40e999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:32738:x1853164419090816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1767316186.333121:0:44074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 218476544 avail 191451136 00000100:00100000:0.0:1767316186.333206:0:44074:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40e999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:32738:x1853164419090816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (5428us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.333214:0:44074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1767316186.333520:0:32739:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e43490ac-1d2e-4c4a-8c39-a2dc980ac0a3:32739:1853164419090944:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.333559:0:32739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.333588:0:32739:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:32739:1853164419091456:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.333609:0:32739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.333624:0:32739:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:32739:1853164419091968:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.333654:0:32739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.333673:0:32739:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1767316186.333679:0:32739:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:32739:1853164419091072:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.333696:0:32739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.333709:0:32739:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:32739:1853164419091584:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.333726:0:32739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.333738:0:32739:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:32739:1853164419092096:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.333756:0:32739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.333778:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:32737:1853164419091200:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.333799:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.333814:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419091712:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.333830:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.333842:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:32737:1853164419092224:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.333877:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.333896:0:32737:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1767316186.333902:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:32737:1853164419091328:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.333920:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.333930:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419091840:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.333962:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.333982:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:32737:1853164419092352:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.334001:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.334021:0:66741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419090944 00000100:00100000:0.0:1767316186.334027:0:66741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419090944 00000100:00100000:0.0:1767316186.334071:0:66741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1767316186.334078:0:66741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e43490ac-1d2e-4c4a-8c39-a2dc980ac0a3+23:32739:x1853164419090944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.334115:0:66741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506fe2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e43490ac-1d2e-4c4a-8c39-a2dc980ac0a3+23:32739:x1853164419090944:12345-0@lo:400:kworker.0 Request processed in 38us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.334121:0:66741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1767316186.334146:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419091456 00000100:00100000:0.0:1767316186.334149:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419091456 00000100:00100000:0.0:1767316186.334176:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419091968 00000100:00100000:0.0:1767316186.334178:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419091968 00000100:00100000:0.0:1767316186.334189:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419091072 00000100:00100000:0.0:1767316186.334191:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419091072 00000100:00100000:0.0:1767316186.334203:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419091200 00000100:00100000:0.0:1767316186.334206:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419091200 00000100:00100000:0.0:1767316186.334216:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419091328 00000100:00100000:0.0:1767316186.334219:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419091328 00000100:00100000:0.0:1767316186.334231:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419092352 00000100:00100000:0.0:1767316186.334234:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419092352 00000100:00100000:0.0:1767316186.334245:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1767316186.334252:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a402f59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:32739:x1853164419091456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.334291:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a402f59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:32739:x1853164419091456:12345-0@lo:400:kworker.0 Request processed in 38us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.334297:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1767316186.334310:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1767316186.334315:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a402f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:32739:x1853164419091968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.334338:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a402f5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:32739:x1853164419091968:12345-0@lo:400:kworker.0 Request processed in 23us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.334344:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1767316186.334355:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1767316186.334361:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a402f59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:32739:x1853164419091072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.334385:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a402f59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:32739:x1853164419091072:12345-0@lo:400:kworker.0 Request processed in 25us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.334391:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1767316186.334402:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1767316186.334408:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a50851a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:32737:x1853164419091200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.334436:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a50851a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:32737:x1853164419091200:12345-0@lo:400:kworker.0 Request processed in 28us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.334466:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1767316186.334477:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1767316186.334482:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a50851b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:32737:x1853164419091328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.334508:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a50851b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:32737:x1853164419091328:12345-0@lo:400:kworker.0 Request processed in 26us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.334514:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1767316186.334524:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1767316186.334528:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5034bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:32737:x1853164419092352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.334564:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5034bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:32737:x1853164419092352:12345-0@lo:400:kworker.0 Request processed in 36us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.334570:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1767316186.334595:0:48845:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419092096 00000100:00100000:0.0:1767316186.334599:0:48845:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419092096 00000100:00100000:0.0:1767316186.334621:0:48845:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419091712 00000100:00100000:0.0:1767316186.334623:0:48845:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419091712 00000100:00100000:0.0:1767316186.334639:0:48845:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419092224 00000100:00100000:0.0:1767316186.334642:0:48845:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419092224 00000100:00100000:0.0:1767316186.334655:0:48845:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419091840 00000100:00100000:0.0:1767316186.334658:0:48845:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419091840 00000100:00100000:0.0:1767316186.334675:0:48845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1767316186.334681:0:48845:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a50851b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:32739:x1853164419092096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.334708:0:48845:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a50851b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:32739:x1853164419092096:12345-0@lo:400:kworker.0 Request processed in 28us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.334714:0:48845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1767316186.334723:0:48845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1767316186.334728:0:48845:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a508518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:32737:x1853164419091712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.334751:0:48845:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a508518000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:32737:x1853164419091712:12345-0@lo:400:kworker.0 Request processed in 23us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.334756:0:48845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1767316186.334764:0:48845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1767316186.334770:0:48845:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a535c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:32737:x1853164419092224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.334793:0:48845:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a535c0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:32737:x1853164419092224:12345-0@lo:400:kworker.0 Request processed in 24us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.334798:0:48845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1767316186.334945:0:48845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1767316186.334957:0:48845:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5034be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:32737:x1853164419091840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.334986:0:48845:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5034be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:32737:x1853164419091840:12345-0@lo:400:kworker.0 Request processed in 29us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.334991:0:48845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00080000:0.0:1767316186.335023:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1767316186.335027:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1767316186.335043:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1767316186.335045:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1767316186.335121:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:32737:1853164419091328:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.335129:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419091840:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.335137:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:32737:1853164419092352:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.335145:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:32737:1853164419091200:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.335153:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419091712:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.335160:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:32737:1853164419092224:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.335194:0:32739:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:32739:1853164419091072:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.335202:0:32739:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:32739:1853164419092096:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.335209:0:32739:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e43490ac-1d2e-4c4a-8c39-a2dc980ac0a3:32739:1853164419090944:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.335218:0:32739:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:32739:1853164419091456:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.335225:0:32739:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:32739:1853164419091968:0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.335248:0:44074:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419091584 00000100:00100000:0.0:1767316186.335251:0:44074:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419091584 00000100:00100000:0.0:1767316186.335275:0:44074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1767316186.335286:0:44074:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a402f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:32739:x1853164419091584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1767316186.335317:0:44074:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a402f5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:32739:x1853164419091584:12345-0@lo:400:kworker.0 Request processed in 32us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.335323:0:44074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:0.0:1767316186.335346:0:32739:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:32739:1853164419091584:0@lo:400:kworker.0 00000100:00100000:1.0:1767316186.335852:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40e999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:32738:1853164419090816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1767316186.340135:0:32739:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a506d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:32739:1853164419092480:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1767316186.340201:0:32739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316186.340259:0:48844:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419092480 00000100:00100000:3.0:1767316186.340268:0:48844:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419092480 00000100:00100000:3.0:1767316186.340311:0:48844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1767316186.340320:0:48844:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:32739:x1853164419092480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1767316186.340353:0:48844:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 218353664 avail 191328256 00000100:00100000:3.0:1767316186.340394:0:48844:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:32739:x1853164419092480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316186.340402:0:48844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1767316186.340469:0:32739:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a506d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:32739:1853164419092480:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1767316186.654190:0:71153:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-scrub test 4e: FID reuse can be fixed ========== 20:09:45 (1767316185) 00000100:00100000:0.0:1767316186.779703:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1767316186.779881:0:66732:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331495680 00000100:00100000:2.0:1767316186.779891:0:66732:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331495680 00000100:00100000:2.0:1767316186.779948:0:66732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 300 00000100:00100000:2.0:1767316186.779957:0:66732:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5034bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+7:34442:x1853164331495680:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:2.0:1767316186.779975:0:66732:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1767316186.780003:0:66732:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e400/0x1c4382d255f6fca9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37efdc expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316186.780074:0:66732:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e200/0x1c4382d255f6fcb0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780093:0:66732:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e200/0x1c4382d255f6fcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780104:0:66732:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e200/0x1c4382d255f6fcb0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780147:0:66732:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e000/0x1c4382d255f6fcb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780154:0:66732:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e000/0x1c4382d255f6fcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780160:0:66732:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e000/0x1c4382d255f6fcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780221:0:66732:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fcbe lrc: 3/1,0 mode: --/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780228:0:66732:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fcbe lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780235:0:66732:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fcbe lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66732 initiator: MDT0 00000004:00200000:2.0:1767316186.780273:0:66732:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200001b72:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1767316186.780277:0:66732:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1767316186.780295:0:66732:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fcbe lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780306:0:66732:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e200/0x1c4382d255f6fcb0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780313:0:66732:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e200/0x1c4382d255f6fcb0 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780318:0:66732:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e200/0x1c4382d255f6fcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780324:0:66732:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e200/0x1c4382d255f6fcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780330:0:66732:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52cb1e200 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:2.0:1767316186.780333:0:66732:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e200/0x1c4382d255f6fcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780339:0:66732:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e200/0x1c4382d255f6fcb0 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780350:0:66732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a537f05f00) 00010000:00010000:2.0:1767316186.780358:0:66732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1767316186.780364:0:66732:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e200/0x1c4382d255f6fcb0 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780370:0:66732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e200/0x1c4382d255f6fcb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780382:0:66732:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e000/0x1c4382d255f6fcb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780387:0:66732:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e000/0x1c4382d255f6fcb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780392:0:66732:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e000/0x1c4382d255f6fcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780397:0:66732:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52cb1e000 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:2.0:1767316186.780400:0:66732:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e000/0x1c4382d255f6fcb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780406:0:66732:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e000/0x1c4382d255f6fcb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780413:0:66732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x31d62d73 (ffff93a50a4c6500) 00010000:00010000:2.0:1767316186.780415:0:66732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1767316186.780418:0:66732:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e000/0x1c4382d255f6fcb7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780423:0:66732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e000/0x1c4382d255f6fcb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66732 initiator: MDT0 00010000:00010000:2.0:1767316186.780674:0:66732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e400/0x1c4382d255f6fca9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efdc expref: 9 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316186.780707:0:66732:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fcbe lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efdc expref: 8 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316186.780714:0:66732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:2.0:1767316186.780717:0:66732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1767316186.780720:0:66732:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52cb1e800, rc 0) 00000100:00100000:2.0:1767316186.780897:0:66732:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5034bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:34442:x1853164331495680:12345-192.168.203.1@tcp:101:rm.0 Request processed in 939us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316186.780906:0:66732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 300 00000100:00100000:3.0:1767316186.792079:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1767316186.792118:0:66737:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331495808 00000100:00100000:3.0:1767316186.792128:0:66737:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331495808 00000100:00100000:3.0:1767316186.792179:0:66737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 34 00000100:00100000:3.0:1767316186.792189:0:66737:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5314b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+8:34442:x1853164331495808:12345-192.168.203.1@tcp:37:rm.0 00000100:00100000:3.0:1767316186.802602:0:66737:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5314b0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+8:34442:x1853164331495808:12345-192.168.203.1@tcp:37:rm.0 Request processed in 10402us (10521us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316186.802616:0:66737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 34 00000100:00100000:3.0:1767316186.831063:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316186.833310:0:66735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331495936 00000100:00100000:0.0:1767316186.833325:0:66735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331495936 00000100:00100000:0.0:1767316186.833434:0:66735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 301 00000100:00100000:0.0:1767316186.833734:0:66735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+8:34442:x1853164331495936:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:0.0:1767316186.833753:0:66735:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1767316186.833772:0:66735:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaacc00/0x1c4382d255f6fcc5 lrc: 2/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37efe3 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316186.833834:0:66735:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaace00/0x1c4382d255f6fccc lrc: 3/1,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.833848:0:66735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaace00/0x1c4382d255f6fccc lrc: 3/1,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.833860:0:66735:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaace00/0x1c4382d255f6fccc lrc: 3/1,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.833874:0:66735:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcd3 lrc: 3/1,0 mode: --/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.833881:0:66735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcd3 lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.833886:0:66735:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcd3 lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.833947:0:66735:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fcda lrc: 3/1,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.833954:0:66735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fcda lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.833960:0:66735:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fcda lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66735 initiator: MDT0 00000004:00010000:0.0:1767316186.833979:0:66735:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fcda lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.833992:0:66735:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaace00/0x1c4382d255f6fccc lrc: 4/1,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.833997:0:66735:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaace00/0x1c4382d255f6fccc lrc: 4/1,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834003:0:66735:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaace00/0x1c4382d255f6fccc lrc: 3/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834008:0:66735:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaace00/0x1c4382d255f6fccc lrc: 4/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834014:0:66735:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52aaace00 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:0.0:1767316186.834018:0:66735:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaace00/0x1c4382d255f6fccc lrc: 4/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834025:0:66735:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaace00/0x1c4382d255f6fccc lrc: 5/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834048:0:66735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:0.0:1767316186.834052:0:66735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316186.834063:0:66735:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaace00/0x1c4382d255f6fccc lrc: 3/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834070:0:66735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaace00/0x1c4382d255f6fccc lrc: 0/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834081:0:66735:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcd3 lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834087:0:66735:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcd3 lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834092:0:66735:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcd3 lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834096:0:66735:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52aaad400 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:0.0:1767316186.834100:0:66735:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcd3 lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834105:0:66735:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcd3 lrc: 4/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834112:0:66735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0xc4959c6c (ffff93a505285500) 00010000:00010000:0.0:1767316186.834115:0:66735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316186.834118:0:66735:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcd3 lrc: 2/0,0 mode: --/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834123:0:66735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcd3 lrc: 0/0,0 mode: --/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.834151:0:66735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaacc00/0x1c4382d255f6fcc5 lrc: 0/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efe3 expref: 10 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316186.834163:0:66735:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fcda lrc: 3/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efe3 expref: 9 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316186.834175:0:66735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285300) 00010000:00010000:0.0:1767316186.834177:0:66735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1767316186.834179:0:66735:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52aaad200, rc 0) 00000100:00100000:0.0:1767316186.834301:0:66735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506d2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+9:34442:x1853164331495936:12345-192.168.203.1@tcp:101:rm.0 Request processed in 572us (3246us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.834310:0:66735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 301 00000100:00100000:3.0:1767316186.839014:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a506d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419092608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1767316186.839094:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316186.839147:0:44064:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419092608 00000100:00100000:3.0:1767316186.839155:0:44064:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419092608 00000100:00100000:3.0:1767316186.839211:0:44064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1767316186.839219:0:44064:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:32740:x1853164419092608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1767316186.839245:0:44064:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 266560 pending 0 free 319000576 avail 291188736 00000100:00100000:2.0:1767316186.839635:0:32738:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1767316186.839803:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40acf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:32738:1853164419092736:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1767316186.839836:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316186.839868:0:44065:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419092736 00000100:00100000:2.0:1767316186.839873:0:44065:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419092736 00000100:00100000:2.0:1767316186.839893:0:44065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1767316186.839900:0:44065:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40acf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:32738:x1853164419092736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1767316186.839911:0:44065:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 266560 pending 0 free 319000576 avail 291188736 00000100:00100000:2.0:1767316186.839950:0:44065:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40acf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:32738:x1853164419092736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316186.839957:0:44065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1767316186.839999:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40acf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:32738:1853164419092736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1767316186.841111:0:44064:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:32740:x1853164419092608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1889us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316186.841119:0:44064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1767316186.841162:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a506d2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419092608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1767316186.841343:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40acf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:32738:1853164419092864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1767316186.841372:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316186.841973:0:44064:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419092864 00000100:00100000:3.0:1767316186.841980:0:44064:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419092864 00000100:00100000:3.0:1767316186.842013:0:44064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1767316186.842021:0:44064:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40acf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:32738:x1853164419092864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1767316186.842059:0:44064:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 266560 pending 0 free 319037440 avail 291225600 00000100:00100000:3.0:1767316186.842101:0:44064:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40acf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:32738:x1853164419092864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316186.842107:0:44064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1767316186.842142:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40acf3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:32738:1853164419092864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1767316186.842368:0:32739:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5034bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:32739:1853164419092992:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1767316186.842400:0:32739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.842432:0:44064:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419092992 00000100:00100000:0.0:1767316186.842436:0:44064:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419092992 00000100:00100000:0.0:1767316186.842500:0:44064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1767316186.842506:0:44064:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5034bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:32739:x1853164419092992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1767316186.842518:0:44064:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 266560 pending 0 free 319037440 avail 291225600 00000100:00100000:0.0:1767316186.842547:0:44064:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5034bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:32739:x1853164419092992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.842554:0:44064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1767316186.842582:0:32739:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5034bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:32739:1853164419092992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1767316186.843736:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316186.844727:0:66735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331496064 00000100:00100000:0.0:1767316186.844738:0:66735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331496064 00000100:00100000:0.0:1767316186.844799:0:66735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 302 00000100:00100000:0.0:1767316186.844808:0:66735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40e999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+5:34442:x1853164331496064:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:0.0:1767316186.844827:0:66735:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1767316186.844850:0:66735:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac800/0x1c4382d255f6fce1 lrc: 2/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37efea expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316186.844922:0:66735:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac600/0x1c4382d255f6fce8 lrc: 3/1,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66735 initiator: MDT0 00010000:00010000:0.0:1767316186.844935:0:66735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac600/0x1c4382d255f6fce8 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66735 initiator: MDT1 00010000:00010000:0.0:1767316186.844948:0:66735:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac600/0x1c4382d255f6fce8 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66735 initiator: MDT1 00000004:00200000:0.0:1767316186.844989:0:66735:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1767316186.844993:0:66735:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:0.0:1767316186.845038:0:66735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac800/0x1c4382d255f6fce1 lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efea expref: 7 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316186.845056:0:66735:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac600/0x1c4382d255f6fce8 lrc: 3/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efea expref: 6 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316186.845064:0:66735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285700) 00010000:00010000:0.0:1767316186.845067:0:66735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1767316186.845071:0:66735:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52aaac600, rc 0) 00000100:00100000:0.0:1767316186.845132:0:66735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40e999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+6:34442:x1853164331496064:12345-192.168.203.1@tcp:101:rm.0 Request processed in 325us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.845140:0:66735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 302 00000100:00100000:3.0:1767316186.853771:0:32732:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316186.853843:0:66732:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331496320 00000100:00100000:0.0:1767316186.853858:0:66732:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331496320 00000100:00100000:0.0:1767316186.853927:0:66732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 303 00000100:00100000:0.0:1767316186.853936:0:66732:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+6:34442:x1853164331496320:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:0.0:1767316186.853954:0:66732:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1767316186.853982:0:66732:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaacc00/0x1c4382d255f6fcef lrc: 2/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37eff1 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316186.854096:0:66732:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcf6 lrc: 3/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66732 initiator: MDT0 00010000:00010000:0.0:1767316186.854110:0:66732:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcf6 lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66732 initiator: MDT1 00010000:00010000:0.0:1767316186.854122:0:66732:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcf6 lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66732 initiator: MDT1 00000004:00200000:0.0:1767316186.854132:0:66732:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1767316186.854242:0:66732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaacc00/0x1c4382d255f6fcef lrc: 0/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37eff1 expref: 9 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316186.854263:0:66732:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcf6 lrc: 3/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37eff1 expref: 8 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316186.854271:0:66732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285700) 00010000:00010000:0.0:1767316186.854273:0:66732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1767316186.854277:0:66732:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52aaad400, rc 0) 00000100:00100000:0.0:1767316186.854350:0:66732:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506d2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:34442:x1853164331496320:12345-192.168.203.1@tcp:101:rm.0 Request processed in 415us (593us total) trans 17179869286 rc 0/0 00000100:00100000:0.0:1767316186.854359:0:66732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 303 00000100:00100000:1.0:1767316186.863721:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1767316186.863779:0:66737:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331496448 00000100:00100000:3.0:1767316186.863796:0:66737:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331496448 00000100:00100000:3.0:1767316186.864057:0:66737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 35 00000100:00100000:3.0:1767316186.864068:0:66737:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40e99b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+8:34442:x1853164331496448:12345-192.168.203.1@tcp:37:rm.0 00000100:00100000:3.0:1767316186.868857:0:66737:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40e99b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+8:34442:x1853164331496448:12345-192.168.203.1@tcp:37:rm.0 Request processed in 4764us (5120us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316186.868876:0:66737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 35 00000100:00100000:2.0:1767316186.875791:0:32732:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1767316186.876040:0:66735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331496576 00000100:00100000:1.0:1767316186.876066:0:66735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331496576 00000100:00100000:1.0:1767316186.876153:0:66735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 304 00000100:00100000:1.0:1767316186.876172:0:66735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40acf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+9:34442:x1853164331496576:12345-192.168.203.1@tcp:41:rm.0 00000004:00000024:1.0:1767316186.876244:0:66735:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 638038016 avail 582414336 00000100:00100000:1.0:1767316186.877398:0:66735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40acf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+9:34442:x1853164331496576:12345-192.168.203.1@tcp:41:rm.0 Request processed in 1223us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316186.877413:0:66735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 304 00000100:00100000:0.0:1767316186.885183:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1767316186.887372:0:66735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331496704 00000100:00100000:1.0:1767316186.887390:0:66735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331496704 00000100:00100000:1.0:1767316186.887486:0:66735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 305 00000100:00100000:1.0:1767316186.887499:0:66735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5034bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+8:34442:x1853164331496704:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:1.0:1767316186.887527:0:66735:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1767316186.887553:0:66735:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4a00/0x1c4382d255f6fd04 lrc: 2/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37eff8 expref: -99 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.887636:0:66735:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4400/0x1c4382d255f6fd0b lrc: 3/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66735 initiator: MDT0 00010000:00010000:1.0:1767316186.887655:0:66735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4400/0x1c4382d255f6fd0b lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887668:0:66735:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4400/0x1c4382d255f6fd0b lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887686:0:66735:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f5e00/0x1c4382d255f6fd12 lrc: 3/1,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66735 initiator: MDT0 00010000:00010000:1.0:1767316186.887693:0:66735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f5e00/0x1c4382d255f6fd12 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887699:0:66735:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f5e00/0x1c4382d255f6fd12 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887862:0:66735:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4400/0x1c4382d255f6fd0b lrc: 4/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887870:0:66735:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4400/0x1c4382d255f6fd0b lrc: 4/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887876:0:66735:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4400/0x1c4382d255f6fd0b lrc: 3/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887883:0:66735:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4400/0x1c4382d255f6fd0b lrc: 4/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887889:0:66735:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a4010f4400 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:1.0:1767316186.887894:0:66735:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4400/0x1c4382d255f6fd0b lrc: 4/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887902:0:66735:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4400/0x1c4382d255f6fd0b lrc: 5/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887917:0:66735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285700) 00010000:00010000:1.0:1767316186.887920:0:66735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1767316186.887926:0:66735:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4400/0x1c4382d255f6fd0b lrc: 3/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887933:0:66735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4400/0x1c4382d255f6fd0b lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887943:0:66735:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f5e00/0x1c4382d255f6fd12 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887949:0:66735:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f5e00/0x1c4382d255f6fd12 lrc: 2/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887955:0:66735:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f5e00/0x1c4382d255f6fd12 lrc: 3/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887967:0:66735:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a4010f5e00 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:1.0:1767316186.887970:0:66735:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f5e00/0x1c4382d255f6fd12 lrc: 3/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887977:0:66735:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f5e00/0x1c4382d255f6fd12 lrc: 4/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887985:0:66735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0xd49b5cf7 (ffff93a505e42400) 00010000:00010000:1.0:1767316186.887988:0:66735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1767316186.887992:0:66735:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f5e00/0x1c4382d255f6fd12 lrc: 2/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.887998:0:66735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f5e00/0x1c4382d255f6fd12 lrc: 0/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66735 initiator: MDT1 00010000:00010000:1.0:1767316186.888045:0:66735:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4a00/0x1c4382d255f6fd04 lrc: 1/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37eff8 expref: 9 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.888057:0:66735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285700) 00010000:00010000:1.0:1767316186.888060:0:66735:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1767316186.888064:0:66735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4a00/0x1c4382d255f6fd04 lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37eff8 expref: 9 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.888074:0:66735:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a4010f4a00, rc 0) 00000100:00100000:1.0:1767316186.888172:0:66735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5034bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:efcdf44b-f089-4822-b0f8-a05beb18178a+8:34442:x1853164331496704:12345-192.168.203.1@tcp:101:rm.0 Request processed in 675us (3003us total) trans 0 rc 301/301 00000100:00100000:1.0:1767316186.888182:0:66735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 305 00000100:00100000:1.0:1767316186.904248:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1767316186.904305:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1767316186.904363:0:66737:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331497088 00000100:00100000:1.0:1767316186.904376:0:66737:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331497088 00000100:00100000:1.0:1767316186.904467:0:66737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 36 00000100:00100000:0.0:1767316186.904474:0:60455:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331496832 00000100:00100000:1.0:1767316186.904479:0:66737:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40e99aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+8:34442:x1853164331497088:12345-192.168.203.1@tcp:35:rm.0 00000100:00100000:0.0:1767316186.904479:0:60455:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331496832 00000100:00100000:0.0:1767316186.904523:0:60455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 89 00000100:00100000:0.0:1767316186.904529:0:60455:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40e99b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:efcdf44b-f089-4822-b0f8-a05beb18178a+9:13815:x1853164331496832:12345-192.168.203.1@tcp:103:rm.0 00010000:00010000:0.0:1767316186.904552:0:60455:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1767316186.904582:0:60455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad200/0x1c4382d255f6fcda lrc: 0/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efe3 expref: 9 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316186.904603:0:60455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285300) 00010000:00010000:0.0:1767316186.904616:0:60455:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1767316186.904678:0:60455:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40e99b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:efcdf44b-f089-4822-b0f8-a05beb18178a+8:13815:x1853164331496832:12345-192.168.203.1@tcp:103:rm.0 Request processed in 148us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.904686:0:60455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 89 00000100:00100000:1.0:1767316186.904736:0:66737:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40e99aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+9:34442:x1853164331497088:12345-192.168.203.1@tcp:35:rm.0 Request processed in 260us (514us total) trans 17179869287 rc 0/0 00000100:00100000:1.0:1767316186.904742:0:66737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 36 00000100:00100000:0.0:1767316186.918222:0:32732:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1767316186.918318:0:66732:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331497344 00000100:00100000:1.0:1767316186.918332:0:66732:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331497344 00000100:00100000:1.0:1767316186.918470:0:66732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 306 00000100:00100000:1.0:1767316186.918483:0:66732:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5034bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+9:34442:x1853164331497344:12345-192.168.203.1@tcp:36:rm.0 00010000:00010000:1.0:1767316186.918572:0:66732:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1767316186.918608:0:66732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad400/0x1c4382d255f6fcf6 lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37eff1 expref: 9 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.918635:0:66732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac600/0x1c4382d255f6fce8 lrc: 0/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efea expref: 8 pid: 66735 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.918648:0:66732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285700) 00010000:00010000:1.0:1767316186.918661:0:66732:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1767316186.918728:0:66732:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 3/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66732 initiator: MDT0 00010000:00010000:1.0:1767316186.918737:0:66732:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 3/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66732 initiator: MDT1 00010000:00010000:1.0:1767316186.918748:0:66732:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 3/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66732 initiator: MDT1 00000100:00100000:1.0:1767316186.918776:0:66732:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40e99b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66732:1853164419093120:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1767316186.918869:0:66732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316186.918902:0:66732:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a52b37e300 going to sleep for 11 seconds 00000100:00100000:3.0:1767316186.919410:0:48355:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419093120 00000100:00100000:3.0:1767316186.919426:0:48355:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419093120 00000100:00100000:3.0:1767316186.919496:0:48355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1767316186.919506:0:48355:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40e99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66732:x1853164419093120:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1767316186.919521:0:48355:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1767316186.919540:0:48355:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e1000/0x1c4382d255f6fd20 lrc: 2/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c4382d255f6fd19 expref: -99 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316186.919569:0:48355:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fcbe lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efdc expref: 7 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316186.919579:0:48355:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e1000/0x1c4382d255f6fd20 lrc: 4/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1c4382d255f6fd19 expref: 7 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316186.919610:0:48355:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fcbe lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efdc expref: 7 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316186.919625:0:48355:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fcbe lrc: 4/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efdc expref: 7 pid: 66732 timeout: 1489 lvb_type: 0 00000100:00100000:3.0:1767316186.919637:0:48355:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a506d2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:48355:1853164419093248:192.168.203.1@tcp:104: 00000100:00100000:3.0:1767316186.919722:0:48355:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a506074600 going to sleep for 11 seconds 00000100:00100000:3.0:1767316186.927011:0:48355:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a506d2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:48355:1853164419093248:192.168.203.1@tcp:104: 00000100:00100000:0.0:1767316186.927895:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1767316186.928233:0:41155:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331497472 00000100:00100000:1.0:1767316186.928246:0:41155:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331497472 00010000:00010000:1.0:1767316186.928299:0:41155:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fcbe lrc: 4/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efdc expref: 8 pid: 66732 timeout: 1489 lvb_type: 0 00000100:00100000:1.0:1767316186.928349:0:41155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 872 00000100:00100000:1.0:1767316186.928361:0:41155:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5034bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:13817:x1853164331497472:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1767316186.928381:0:41155:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1767316186.928389:0:41155:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fcbe lrc: 4/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efdc expref: 8 pid: 66732 timeout: 1489 lvb_type: 0 00010000:00010000:1.0:1767316186.928403:0:41155:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fcbe lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efdc expref: 8 pid: 66732 timeout: 1489 lvb_type: 0 00010000:00010000:1.0:1767316186.928432:0:41155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52cb1e800/0x1c4382d255f6fcbe lrc: 0/0,0 mode: --/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efdc expref: 8 pid: 66732 timeout: 1489 lvb_type: 0 00010000:00010000:1.0:1767316186.928484:0:41155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:1.0:1767316186.928493:0:41155:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e1000/0x1c4382d255f6fd20 lrc: 3/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1c4382d255f6fd19 expref: 7 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.928506:0:41155:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e1000/0x1c4382d255f6fd20 lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x1c4382d255f6fd19 expref: 7 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.928517:0:41155:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e1000/0x1c4382d255f6fd20 lrc: 4/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x1c4382d255f6fd19 expref: 7 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.928583:0:41155:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e1000/0x1c4382d255f6fd20 lrc: 4/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6fd19 expref: 7 pid: 48355 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1767316186.928600:0:41155:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40e998e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:41155:1853164419093376:0@lo:105: 00000100:00100000:1.0:1767316186.928672:0:41155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316186.928724:0:41155:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a5062c6300 going to sleep for 11 seconds 00000100:00100000:2.0:1767316186.929143:0:41151:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419093376 00000100:00100000:2.0:1767316186.929163:0:41151:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419093376 00000100:00100000:2.0:1767316186.929213:0:41151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1767316186.929223:0:41151:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40e99a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:41155:x1853164419093376:12345-0@lo:105: 00010000:00010000:2.0:1767316186.929238:0:41151:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 4/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316186.929250:0:41151:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 4/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316186.929260:0:41151:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 4/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316186.929270:0:41151:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 4/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316186.929278:0:41151:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 5/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316186.929287:0:41151:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 5/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316186.929305:0:41151:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff93a4010f4a00) 00000100:00100000:2.0:1767316186.929362:0:41151:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40e99a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0001-mdtlov_UUID+4:41155:x1853164419093376:12345-0@lo:105: Request processed in 140us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316186.929370:0:41151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1767316186.929421:0:41155:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40e998e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:41155:1853164419093376:0@lo:105: 00010000:00010000:2.0:1767316186.929466:0:41155:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1767316186.929519:0:41155:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5034bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+7:13817:x1853164331497472:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 1159us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316186.929536:0:41155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 872 00010000:00010000:3.0:1767316186.930000:0:48355:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e1000/0x1c4382d255f6fd20 lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6fd19 expref: 7 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316186.930015:0:48355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:3.0:1767316186.930018:0:48355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1767316186.930022:0:48355:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a5313e1000, rc 0) 00000100:00100000:3.0:1767316186.931268:0:48355:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40e99bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66732:x1853164419093120:12345-0@lo:101:mdt00_000.0 Request processed in 11759us (12393us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316186.931280:0:48355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1767316186.931376:0:66732:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40e99b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66732:1853164419093120:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1767316186.931406:0:66732:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 4/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1767316186.931682:0:66732:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200001b72:0x1:0x0] 00010000:00010000:1.0:1767316186.931745:0:66732:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 3/0,1 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66732 initiator: MDT0 00010000:00010000:1.0:1767316186.931754:0:66732:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 3/0,1 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66732 initiator: MDT1 00010000:00010000:1.0:1767316186.931765:0:66732:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 3/0,1 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66732 initiator: MDT1 00000100:00100000:1.0:1767316186.931790:0:66732:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40e99b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66732:1853164419093504:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1767316186.931836:0:66732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316186.932008:0:66732:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a5062c6300 going to sleep for 11 seconds 00000100:00100000:3.0:1767316186.932110:0:48355:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419093504 00000100:00100000:3.0:1767316186.932119:0:48355:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419093504 00000100:00100000:3.0:1767316186.932327:0:48355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1767316186.932338:0:48355:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40e998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66732:x1853164419093504:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1767316186.932359:0:48355:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1767316186.932380:0:48355:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e0600/0x1c4382d255f6fd2e lrc: 2/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c4382d255f6fd27 expref: -99 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316186.932409:0:48355:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e0600/0x1c4382d255f6fd2e lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1c4382d255f6fd27 expref: 8 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316186.932424:0:48355:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e0600/0x1c4382d255f6fd2e lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6fd27 expref: 8 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316186.932433:0:48355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0xc4959c6c (ffff93a511516400) 00010000:00010000:3.0:1767316186.932470:0:48355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1767316186.932475:0:48355:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a5313e0600, rc 0) 00000100:00100000:3.0:1767316186.932521:0:48355:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40e998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66732:x1853164419093504:12345-0@lo:101:mdt00_000.0 Request processed in 184us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316186.932528:0:48355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1767316186.932610:0:66732:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40e99b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66732:1853164419093504:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1767316186.932624:0:66732:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 4/0,1 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1c4382d255f6fd2e expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.932634:0:66732:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 4/0,1 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fd2e expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1767316186.932666:0:66732:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200001b72:0x1:0x0] 00000100:00100000:1.0:1767316186.932714:0:66732:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40e99b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66732:1853164419093632:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1767316186.932744:0:66732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316186.933086:0:66732:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a52b37e300 going to sleep for 11 seconds 00000100:00100000:0.0:1767316186.933139:0:48844:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419093632 00000100:00100000:0.0:1767316186.933145:0:48844:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419093632 00000100:00100000:0.0:1767316186.933192:0:48844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1767316186.933201:0:48844:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40e999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66732:x1853164419093632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1767316186.933277:0:48844:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40e999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66732:x1853164419093632:12345-0@lo:1000:mdt00_000.0 Request processed in 77us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.933284:0:48844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:1.0:1767316186.933395:0:66732:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40e99b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66732:1853164419093632:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1767316186.933483:0:66732:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40e99b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66732:1853164419093760:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1767316186.933513:0:66732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316186.933531:0:66732:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a5062c6300 going to sleep for 11 seconds 00000100:00100000:0.0:1767316186.933674:0:44073:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419093760 00000100:00100000:0.0:1767316186.933678:0:44073:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419093760 00000100:00100000:0.0:1767316186.933714:0:44073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1767316186.933721:0:44073:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40e998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66732:x1853164419093760:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1767316186.933810:0:44073:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40e998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66732:x1853164419093760:12345-0@lo:1000:mdt00_000.0 Request processed in 89us (297us total) trans 0 rc 1/1 00000100:00100000:0.0:1767316186.933818:0:44073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1767316186.933888:0:66732:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40e99b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66732:1853164419093760:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1767316186.934089:0:66732:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 3/0,1 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66732 initiator: MDT0 00010000:00010000:1.0:1767316186.934109:0:66732:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 3/0,1 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66732 initiator: MDT1 00010000:00010000:1.0:1767316186.934125:0:66732:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 3/0,1 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66732 initiator: MDT1 00000100:00100000:1.0:1767316186.934164:0:66732:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40e99b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66732:1853164419093888:0@lo:101:mdt00_000.0 00000100:00100000:1.0:1767316186.934231:0:66732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316186.934281:0:66732:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a52b37e300 going to sleep for 11 seconds 00000100:00100000:3.0:1767316186.935689:0:48355:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419093888 00000100:00100000:3.0:1767316186.935706:0:48355:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419093888 00000100:00100000:3.0:1767316186.935809:0:48355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:3.0:1767316186.935820:0:48355:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40e998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66732:x1853164419093888:12345-0@lo:101:mdt00_000.0 00010000:00010000:3.0:1767316186.935855:0:48355:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1767316186.935920:0:48355:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fd3c lrc: 2/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c4382d255f6fd35 expref: -99 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316186.936285:0:48355:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fd3c lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1c4382d255f6fd35 expref: 9 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316186.936306:0:48355:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fd3c lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6fd35 expref: 9 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316186.936315:0:48355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a511516000) 00010000:00010000:3.0:1767316186.936319:0:48355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1767316186.936323:0:48355:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a5313e1e00, rc 0) 00000100:00100000:3.0:1767316186.936431:0:48355:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40e998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66732:x1853164419093888:12345-0@lo:101:mdt00_000.0 Request processed in 611us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316186.936469:0:48355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1767316186.936597:0:66732:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40e99b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-mdtlov_UUID:66732:1853164419093888:0@lo:101:mdt00_000.0 00010000:00010000:1.0:1767316186.936622:0:66732:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 4/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1c4382d255f6fd3c expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.936636:0:66732:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 4/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fd3c expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.936696:0:66732:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4c00/0x1c4382d255f6fd43 lrc: 3/0,1 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66732 initiator: MDT0 00010000:00010000:1.0:1767316186.936706:0:66732:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4c00/0x1c4382d255f6fd43 lrc: 3/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66732 initiator: MDT1 00010000:00010000:1.0:1767316186.936714:0:66732:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4c00/0x1c4382d255f6fd43 lrc: 3/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66732 initiator: MDT1 00010000:00010000:1.0:1767316186.936840:0:66732:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4c00/0x1c4382d255f6fd43 lrc: 3/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66732 initiator: MDT1 00010000:00010000:1.0:1767316186.936859:0:66732:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4c00/0x1c4382d255f6fd43 lrc: 2/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66732 initiator: MDT1 00010000:00010000:1.0:1767316186.936866:0:66732:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4c00/0x1c4382d255f6fd43 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66732 initiator: MDT1 00010000:00010000:1.0:1767316186.936873:0:66732:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a4010f4c00 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:1.0:1767316186.936878:0:66732:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4c00/0x1c4382d255f6fd43 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66732 initiator: MDT1 00010000:00010000:1.0:1767316186.936886:0:66732:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4c00/0x1c4382d255f6fd43 lrc: 4/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66732 initiator: MDT1 00010000:00010000:1.0:1767316186.936899:0:66732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505e42200) 00010000:00010000:1.0:1767316186.936902:0:66732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1767316186.936906:0:66732:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4c00/0x1c4382d255f6fd43 lrc: 2/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66732 initiator: MDT1 00010000:00010000:1.0:1767316186.936912:0:66732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a4010f4c00/0x1c4382d255f6fd43 lrc: 0/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66732 initiator: MDT1 00010000:00010000:1.0:1767316186.936944:0:66732:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 4/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fd3c expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.936952:0:66732:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 4/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fd3c expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.936959:0:66732:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fd3c expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.936988:0:66732:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1767316186.936999:0:66732:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200001b72:0x1:0x0] 00010000:00010000:1.0:1767316186.937006:0:66732:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 4/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937012:0:66732:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 4/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937019:0:66732:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937051:0:66732:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1767316186.937056:0:66732:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200001b72:0x1:0x0] 00010000:00010000:1.0:1767316186.937061:0:66732:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 4/0,1 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fd2e expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937068:0:66732:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 4/0,1 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fd2e expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937075:0:66732:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fd2e expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937093:0:66732:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:1.0:1767316186.937370:0:66732:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5034bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+7:34442:x1853164331497344:12345-192.168.203.1@tcp:36:rm.0 Request processed in 18885us (19155us total) trans 0 rc -39/-39 00000100:00100000:1.0:1767316186.937379:0:66732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 306 00010000:00010000:1.0:1767316186.937416:0:41158:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1767316186.937423:0:41158:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 2/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1c4382d255f6fd3c expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937431:0:41158:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a4010f4400 already unused, calling callback (ffffffffc17e9290) 00010000:00010000:1.0:1767316186.937436:0:41158:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1c4382d255f6fd3c expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1767316186.937478:0:41158:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1c4382d255f6fd3c expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937515:0:41158:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 2/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fd3c expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937522:0:41158:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316186.937545:0:41158:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 1/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fd3c expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937552:0:41158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4400/0x1c4382d255f6fd35 lrc: 0/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fd3c expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937570:0:41158:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1767316186.937574:0:41158:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 2/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937594:0:41158:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a4010f4a00 already unused, calling callback (ffffffffc17e9290) 00010000:00010000:1.0:1767316186.937597:0:41158:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1767316186.937604:0:41158:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937621:0:41158:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 2/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937627:0:41158:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316186.937640:0:41158:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 1/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937647:0:41158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f4a00/0x1c4382d255f6fd19 lrc: 0/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fd20 expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937659:0:41158:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1767316186.937663:0:41158:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 2/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1c4382d255f6fd2e expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937669:0:41158:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a4010f5e00 already unused, calling callback (ffffffffc17e9290) 00010000:00010000:1.0:1767316186.937673:0:41158:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1c4382d255f6fd2e expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1767316186.937680:0:41158:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1c4382d255f6fd2e expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937696:0:41158:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 2/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fd2e expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937708:0:41158:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1767316186.937716:0:41158:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 1/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fd2e expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937722:0:41158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a4010f5e00/0x1c4382d255f6fd27 lrc: 0/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fd2e expref: -99 pid: 66732 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.937735:0:41158:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316186.937737:0:41158:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316186.937739:0:41158:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767316186.937820:0:46026:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767316186.937827:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767316186.937931:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:32738:1853164419094272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1767316186.938003:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316186.938070:0:32738:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767316186.938077:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a53495c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:32738:1853164419094144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1767316186.938099:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.938276:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40e99b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419094016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1767316186.938322:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316186.938371:0:41157:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419094272 00000100:00100000:0.0:1767316186.938380:0:41157:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419094272 00000100:00100000:0.0:1767316186.938460:0:41157:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419094144 00000100:00100000:0.0:1767316186.938464:0:41157:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419094144 00000100:00100000:0.0:1767316186.938488:0:41157:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419094016 00000100:00100000:0.0:1767316186.938491:0:41157:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419094016 00000100:00100000:0.0:1767316186.938515:0:41157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1767316186.938524:0:41157:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:32738:x1853164419094272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1767316186.938541:0:41157:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1767316186.938566:0:41157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e0600/0x1c4382d255f6fd2e lrc: 0/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1c4382d255f6fd27 expref: 11 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316186.938583:0:41157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0xc4959c6c (ffff93a511516400) 00010000:00010000:0.0:1767316186.938595:0:41157:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1767316186.938668:0:60455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1767316186.938678:0:60455:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+10:32738:x1853164419094144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1767316186.938687:0:60455:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1767316186.938700:0:60455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e1000/0x1c4382d255f6fd20 lrc: 0/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1c4382d255f6fd19 expref: 10 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316186.938711:0:60455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:3.0:1767316186.938723:0:60455:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1767316186.938794:0:41155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1767316186.938805:0:41155:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506070c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+9:32740:x1853164419094016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1767316186.938814:0:41155:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1767316186.938826:0:41155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fd3c lrc: 0/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1c4382d255f6fd35 expref: 9 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316186.938838:0:41155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a511516000) 00010000:00010000:1.0:1767316186.938845:0:41155:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1767316186.938893:0:41155:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506070c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0001-mdtlov_UUID+8:32740:x1853164419094016:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316186.938900:0:41155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1767316186.939837:0:41157:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506d2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:32738:x1853164419094272:12345-0@lo:103:ldlm_bl.0 Request processed in 1305us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316186.939857:0:41157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1767316186.939924:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40e99b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419094016:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1767316186.940300:0:60455:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506d2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:lustre-MDT0001-mdtlov_UUID+6:32738:x1853164419094144:12345-0@lo:103:ldlm_bl.0 Request processed in 1622us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316186.940309:0:60455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1767316186.940674:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a53495c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:32738:1853164419094144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1767316186.940686:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a53495df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:32738:1853164419094272:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1767316187.030737:0:41158:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1767316188.054947:0:46026:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1767316188.936863:0:71201:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-scrub test_4e: @@@@@@ FAIL: Fail to cleanup the env! 00010000:00010000:3.0:1767316189.085415:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316190.106039:0:41158:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 658 lines, 658 kept, 0 dropped, 0 bad.