00010000:00010000:2.0F:1767316167.575243:0:41158:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1767316168.599510:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0F:1767316168.934792:0:66726:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0001: transno 17179869281 is committed 00010000:00010000:1.0F:1767316169.625045:0:46026:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316170.507216:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316170.507251:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316170.507275:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316170.507303:0:66733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331490560 00000100:00100000:0.0:1767316170.507312:0:66733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331490560 00000100:00100000:0.0:1767316170.507358:0:66733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331490432 00000100:00100000:0.0:1767316170.507360:0:66733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331490432 00000100:00100000:0.0:1767316170.507382:0:66733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 102 00000100:00100000:0.0:1767316170.507391:0:66733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a537f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+5:13818:x1853164331490560:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1767316170.507483:0:66733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a537f7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+5:13818:x1853164331490560:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 93us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316170.507491:0:66733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 102 00000100:00100000:0.0:1767316170.507510:0:66733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 103 00000100:00100000:0.0:1767316170.507517:0:66733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a537f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+7:13818:x1853164331490432:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:0.0:1767316170.507543:0:66733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a537f7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+7:13818:x1853164331490432:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 27us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316170.507549:0:66733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 103 00000100:00100000:3.0:1767316170.509198:0:66742:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331490304 00000100:00100000:3.0:1767316170.509210:0:66742:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331490304 00000100:00100000:3.0:1767316170.509263:0:66742:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 134 00000100:00100000:3.0:1767316170.509271:0:66742:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf5678e5-f4dd-43cf-82e3-0b8dc9fe1870+9:13816:x1853164331490304:12345-192.168.203.1@tcp:400:kworker.0 00000100:00100000:3.0:1767316170.509330:0:66742:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506fe2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bf5678e5-f4dd-43cf-82e3-0b8dc9fe1870+9:13816:x1853164331490304:12345-192.168.203.1@tcp:400:kworker.0 Request processed in 60us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316170.509338:0:66742:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 134 00000100:00080000:3.0:1767316170.509367:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1767316170.509372:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1767316170.646558:0:41158:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1767316170.885302:0:70661:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-scrub test 4c: Auto trigger OI scrub if bad OI mapping was found (3) ========================================================== 20:09:29 (1767316169) 00000100:00100000:2.0:1767316170.966689:0:32737:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767316170.966711:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a534e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419081344:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1767316170.966776:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316170.966843:0:48355:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419081344 00000100:00100000:2.0:1767316170.966851:0:48355:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419081344 00000100:00100000:2.0:1767316170.966896:0:48355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1767316170.966904:0:48355:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a534e20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:32737:x1853164419081344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1767316170.966938:0:48355:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 218353664 avail 191328256 00000100:00100000:2.0:1767316170.966982:0:48355:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a534e20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:32737:x1853164419081344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316170.966990:0:48355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:2.0:1767316170.967044:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a534e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419081344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1767316170.967408:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a402f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:32740:1853164419081600:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.967490:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316170.967510:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bbb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419082112:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.967531:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316170.967546:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419082624:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.967561:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316170.967576:0:32740:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1767316170.967580:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40ac4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e43490ac-1d2e-4c4a-8c39-a2dc980ac0a3:32740:1853164419081472:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.967601:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316170.967618:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:32740:1853164419081984:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.967634:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316170.967648:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419082496:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.967664:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316170.967711:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419081600 00000100:00100000:1.0:1767316170.967715:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419081600 00000100:00100000:1.0:1767316170.967752:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419081984 00000100:00100000:1.0:1767316170.967755:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419081984 00000100:00100000:1.0:1767316170.967771:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1767316170.967777:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:32740:x1853164419081600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.967808:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:32740:x1853164419081600:12345-0@lo:400:kworker.0 Request processed in 31us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316170.967814:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1767316170.967826:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1767316170.967832:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:32740:x1853164419081984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.967853:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:32740:x1853164419081984:12345-0@lo:400:kworker.0 Request processed in 22us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316170.967870:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1767316170.967888:0:44059:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419082112 00000100:00100000:1.0:1767316170.967891:0:44059:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419082112 00000100:00100000:1.0:1767316170.967911:0:44059:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419082624 00000100:00100000:1.0:1767316170.967914:0:44059:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419082624 00000100:00100000:1.0:1767316170.967927:0:44059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1767316170.967932:0:44059:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:32740:x1853164419082112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.967958:0:44059:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:32740:x1853164419082112:12345-0@lo:400:kworker.0 Request processed in 26us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316170.967963:0:44059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1767316170.967971:0:44059:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1767316170.967975:0:44059:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:32740:x1853164419082624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.967996:0:44059:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:32740:x1853164419082624:12345-0@lo:400:kworker.0 Request processed in 20us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316170.968002:0:44059:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00080000:1.0:1767316170.968020:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1767316170.968095:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1767316170.968099:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1767316170.968120:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a53495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:32738:1853164419081856:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968154:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316170.968182:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:32738:1853164419082368:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968202:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316170.968216:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:32738:1853164419082880:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968233:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316170.968248:0:32738:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1767316170.968253:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a53495ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:32738:1853164419081728:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968280:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316170.968290:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:32738:1853164419082240:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968309:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316170.968322:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:32738:1853164419082752:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968339:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316170.968359:0:66735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419081856 00000100:00100000:1.0:1767316170.968363:0:66735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419081856 00000100:00100000:1.0:1767316170.968385:0:66735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419082368 00000100:00100000:1.0:1767316170.968387:0:66735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419082368 00000100:00100000:1.0:1767316170.968397:0:66735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419082880 00000100:00100000:1.0:1767316170.968399:0:66735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419082880 00000100:00100000:1.0:1767316170.968408:0:66735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419081728 00000100:00100000:1.0:1767316170.968411:0:66735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419081728 00000100:00100000:1.0:1767316170.968425:0:66735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1767316170.968430:0:66735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:32738:x1853164419081856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968487:0:66735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:32738:x1853164419081856:12345-0@lo:400:kworker.0 Request processed in 56us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316170.968493:0:66735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1767316170.968505:0:66735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1767316170.968510:0:66735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:32738:x1853164419082368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968535:0:66735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:32738:x1853164419082368:12345-0@lo:400:kworker.0 Request processed in 25us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316170.968541:0:66735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1767316170.968552:0:66735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1767316170.968557:0:66735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:32738:x1853164419082880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968582:0:66735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:32738:x1853164419082880:12345-0@lo:400:kworker.0 Request processed in 24us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316170.968593:0:66735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1767316170.968603:0:66735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1767316170.968607:0:66735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bbba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:32738:x1853164419081728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968634:0:66735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bbba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:32738:x1853164419081728:12345-0@lo:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316170.968638:0:66735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1767316170.968653:0:48849:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419082240 00000100:00100000:1.0:1767316170.968656:0:48849:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419082240 00000100:00100000:1.0:1767316170.968674:0:48849:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419082752 00000100:00100000:1.0:1767316170.968677:0:48849:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419082752 00000100:00100000:1.0:1767316170.968692:0:48849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1767316170.968696:0:48849:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a503f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:32738:x1853164419082240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968724:0:48849:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a503f7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:32738:x1853164419082240:12345-0@lo:400:kworker.0 Request processed in 27us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316170.968729:0:48849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1767316170.968738:0:48849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1767316170.968743:0:48849:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a503f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:32738:x1853164419082752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968766:0:48849:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a503f7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:32738:x1853164419082752:12345-0@lo:400:kworker.0 Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316170.968772:0:48849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00080000:1.0:1767316170.968791:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1767316170.968794:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1767316170.968795:0:41185:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1767316170.968825:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:32740:1853164419081984:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968835:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a402f5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:32740:1853164419081600:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968853:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bbb8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419082112:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968861:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419082624:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968875:0:32740:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1767316170.968882:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419083008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1767316170.968907:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1767316170.968933:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a53495ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:32738:1853164419081728:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968941:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bbba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:32738:1853164419082240:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968949:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bbb9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:32738:1853164419082752:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968957:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a53495f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:32738:1853164419081856:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968964:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bbb9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:32738:1853164419082368:0@lo:400:kworker.0 00000100:00100000:1.0:1767316170.968971:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:32738:1853164419082880:0@lo:400:kworker.0 00000100:00100000:2.0:1767316170.969321:0:66741:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419081472 00000100:00100000:2.0:1767316170.969326:0:66741:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419081472 00000100:00100000:2.0:1767316170.969366:0:66741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1767316170.969372:0:66741:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e43490ac-1d2e-4c4a-8c39-a2dc980ac0a3+23:32740:x1853164419081472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1767316170.969412:0:66741:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506fe0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e43490ac-1d2e-4c4a-8c39-a2dc980ac0a3+23:32740:x1853164419081472:12345-0@lo:400:kworker.0 Request processed in 41us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316170.969418:0:66741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1767316170.969468:0:44074:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419082496 00000100:00100000:2.0:1767316170.969472:0:44074:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419082496 00000100:00100000:2.0:1767316170.969494:0:44074:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419083008 00000100:00100000:2.0:1767316170.969497:0:44074:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419083008 00000100:00100000:2.0:1767316170.969555:0:44074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1767316170.969561:0:44074:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bbb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:32740:x1853164419082496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1767316170.969591:0:44074:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bbb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:32740:x1853164419082496:12345-0@lo:400:kworker.0 Request processed in 31us (1925us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316170.969603:0:44074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1767316170.969615:0:44074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1767316170.969621:0:44074:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a503f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:32740:x1853164419083008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1767316170.969642:0:44074:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 218476544 avail 191451136 00000100:00100000:2.0:1767316170.969671:0:44074:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a503f7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:32740:x1853164419083008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316170.969677:0:44074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:2.0:1767316170.969805:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bbb9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419083008:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1767316170.969815:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40ac4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e43490ac-1d2e-4c4a-8c39-a2dc980ac0a3:32740:1853164419081472:0@lo:400:kworker.0 00000100:00100000:2.0:1767316170.969822:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bbb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:32740:1853164419082496:0@lo:400:kworker.0 00000001:00100000:0.0:1767316170.973895:0:44053:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of efcdf44b-f089-4822-b0f8-a05beb18178a 00000020:00000080:0.0:1767316170.973904:0:44053:0:(genops.c:904:class_export_put()) final put ffff93a538b45800/efcdf44b-f089-4822-b0f8-a05beb18178a 00000020:00000080:2.0:1767316170.974418:0:55625:0:(genops.c:863:class_export_destroy()) destroying export ffff93a538b45800/efcdf44b-f089-4822-b0f8-a05beb18178a for lustre-OST0001 00000020:00000080:1.0:1767316170.978295:0:56999:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff93a538b44000 for lustre-OST0001 00000001:00100000:2.0:1767316170.983094:0:44075:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of efcdf44b-f089-4822-b0f8-a05beb18178a 00000020:00000080:2.0:1767316170.983104:0:44075:0:(genops.c:904:class_export_put()) final put ffff93a505ef8000/efcdf44b-f089-4822-b0f8-a05beb18178a 00000020:00000080:1.0:1767316170.983281:0:56999:0:(genops.c:863:class_export_destroy()) destroying export ffff93a505ef8000/efcdf44b-f089-4822-b0f8-a05beb18178a for lustre-OST0000 00000020:00000080:1.0:1767316170.983328:0:56999:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff93a505ef9000 for lustre-OST0000 00000100:00100000:0.0:1767316171.021966:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1767316171.030026:0:66733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331490688 00000100:00100000:1.0:1767316171.030042:0:66733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331490688 00000100:00100000:1.0:1767316171.030103:0:66733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 286 00000100:00100000:1.0:1767316171.030113:0:66733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a537f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+7:33229:x1853164331490688:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:1.0:1767316171.030132:0:66733:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1767316171.030164:0:66733:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5800/0x1c4382d255f6fb67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37ef96 expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316171.030229:0:66733:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f4600/0x1c4382d255f6fb6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030251:0:66733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f4600/0x1c4382d255f6fb6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030263:0:66733:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f4600/0x1c4382d255f6fb6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030278:0:66733:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5000/0x1c4382d255f6fb75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030286:0:66733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5000/0x1c4382d255f6fb75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030291:0:66733:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5000/0x1c4382d255f6fb75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030343:0:66733:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5400/0x1c4382d255f6fb7c lrc: 3/1,0 mode: --/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030350:0:66733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5400/0x1c4382d255f6fb7c lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030357:0:66733:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5400/0x1c4382d255f6fb7c lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66733 initiator: MDT0 00000004:00200000:1.0:1767316171.030398:0:66733:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200001b72:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1767316171.030401:0:66733:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1767316171.030419:0:66733:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5400/0x1c4382d255f6fb7c lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030429:0:66733:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f4600/0x1c4382d255f6fb6e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030435:0:66733:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f4600/0x1c4382d255f6fb6e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030466:0:66733:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f4600/0x1c4382d255f6fb6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030472:0:66733:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f4600/0x1c4382d255f6fb6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030478:0:66733:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a4010f4600 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:1.0:1767316171.030482:0:66733:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f4600/0x1c4382d255f6fb6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030488:0:66733:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f4600/0x1c4382d255f6fb6e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030500:0:66733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93a537f05f00) 00010000:00010000:1.0:1767316171.030503:0:66733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1767316171.030507:0:66733:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f4600/0x1c4382d255f6fb6e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030513:0:66733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f4600/0x1c4382d255f6fb6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030523:0:66733:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5000/0x1c4382d255f6fb75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030529:0:66733:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5000/0x1c4382d255f6fb75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030534:0:66733:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5000/0x1c4382d255f6fb75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030539:0:66733:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a4010f5000 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:1.0:1767316171.030541:0:66733:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5000/0x1c4382d255f6fb75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030557:0:66733:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5000/0x1c4382d255f6fb75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030565:0:66733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x31d62d73 (ffff93a505e42200) 00010000:00010000:1.0:1767316171.030567:0:66733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1767316171.030570:0:66733:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5000/0x1c4382d255f6fb75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030576:0:66733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5000/0x1c4382d255f6fb75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x31d62d73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66733 initiator: MDT0 00010000:00010000:1.0:1767316171.030605:0:66733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5800/0x1c4382d255f6fb67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef96 expref: 9 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316171.030617:0:66733:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5400/0x1c4382d255f6fb7c lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef96 expref: 8 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316171.030624:0:66733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:1.0:1767316171.030626:0:66733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1767316171.030629:0:66733:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a4010f5400, rc 0) 00000100:00100000:1.0:1767316171.030695:0:66733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a537f7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+8:33229:x1853164331490688:12345-192.168.203.1@tcp:101:rm.0 Request processed in 583us (8740us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316171.030703:0:66733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 286 00000100:00100000:0.0:1767316171.037640:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1767316171.037721:0:66736:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331490816 00000100:00100000:2.0:1767316171.037731:0:66736:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331490816 00000100:00100000:2.0:1767316171.037873:0:66736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 28 00000100:00100000:2.0:1767316171.037883:0:66736:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a537f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:33229:x1853164331490816:12345-192.168.203.1@tcp:37:rm.0 00000100:00100000:2.0:1767316171.048989:0:66736:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a537f7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:33229:x1853164331490816:12345-192.168.203.1@tcp:37:rm.0 Request processed in 11098us (11348us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316171.049003:0:66736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 28 00000100:00100000:0.0:1767316171.061241:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316171.061279:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331490944 00000100:00100000:0.0:1767316171.061289:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331490944 00000100:00100000:0.0:1767316171.061342:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 287 00000100:00100000:0.0:1767316171.061351:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a537f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+8:33229:x1853164331490944:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:0.0:1767316171.061379:0:66756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1767316171.061401:0:66756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac600/0x1c4382d255f6fb83 lrc: 2/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37ef9d expref: -99 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.061483:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad800/0x1c4382d255f6fb8a lrc: 3/1,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061497:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad800/0x1c4382d255f6fb8a lrc: 3/1,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061507:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad800/0x1c4382d255f6fb8a lrc: 3/1,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061519:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fb91 lrc: 3/1,0 mode: --/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061526:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fb91 lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061532:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fb91 lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061578:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaadc00/0x1c4382d255f6fb98 lrc: 3/1,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061585:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaadc00/0x1c4382d255f6fb98 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061590:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaadc00/0x1c4382d255f6fb98 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT0 00000004:00010000:0.0:1767316171.061609:0:66756:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaadc00/0x1c4382d255f6fb98 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061621:0:66756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad800/0x1c4382d255f6fb8a lrc: 3/1,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061634:0:66756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad800/0x1c4382d255f6fb8a lrc: 2/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061641:0:66756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad800/0x1c4382d255f6fb8a lrc: 3/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061646:0:66756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52aaad800 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:0.0:1767316171.061650:0:66756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad800/0x1c4382d255f6fb8a lrc: 3/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061657:0:66756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad800/0x1c4382d255f6fb8a lrc: 4/0,0 mode: CR/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061669:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:0.0:1767316171.061672:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316171.061678:0:66756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad800/0x1c4382d255f6fb8a lrc: 2/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061683:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad800/0x1c4382d255f6fb8a lrc: 0/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061695:0:66756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fb91 lrc: 3/1,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061700:0:66756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fb91 lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061705:0:66756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fb91 lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061709:0:66756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52aaaca00 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:0.0:1767316171.061712:0:66756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fb91 lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061726:0:66756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fb91 lrc: 4/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061733:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0xc4959c6c (ffff93a505285100) 00010000:00010000:0.0:1767316171.061736:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316171.061738:0:66756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fb91 lrc: 2/0,0 mode: --/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061743:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fb91 lrc: 0/0,0 mode: --/PR res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.061774:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaac600/0x1c4382d255f6fb83 lrc: 0/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef9d expref: 10 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.061786:0:66756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaadc00/0x1c4382d255f6fb98 lrc: 3/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef9d expref: 9 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.061793:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285e00) 00010000:00010000:0.0:1767316171.061795:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1767316171.061798:0:66756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52aaadc00, rc 0) 00000100:00100000:0.0:1767316171.061964:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a537f7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+9:33229:x1853164331490944:12345-192.168.203.1@tcp:101:rm.0 Request processed in 612us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316171.061972:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 287 00000100:00100000:0.0:1767316171.069641:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1767316171.075425:0:66733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331491072 00000100:00100000:3.0:1767316171.075454:0:66733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331491072 00000100:00100000:3.0:1767316171.075517:0:66733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 288 00000100:00100000:3.0:1767316171.075528:0:66733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a537f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+5:33229:x1853164331491072:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:3.0:1767316171.075547:0:66733:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1767316171.075569:0:66733:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0000/0x1c4382d255f6fb9f lrc: 2/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37efa4 expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.075639:0:66733:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0e00/0x1c4382d255f6fba6 lrc: 3/1,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66733 initiator: MDT0 00010000:00010000:3.0:1767316171.075653:0:66733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0e00/0x1c4382d255f6fba6 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66733 initiator: MDT1 00010000:00010000:3.0:1767316171.075666:0:66733:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0e00/0x1c4382d255f6fba6 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66733 initiator: MDT1 00000004:00200000:3.0:1767316171.075709:0:66733:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1767316171.075712:0:66733:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00010000:00010000:3.0:1767316171.075755:0:66733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0000/0x1c4382d255f6fb9f lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efa4 expref: 7 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.075769:0:66733:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0e00/0x1c4382d255f6fba6 lrc: 3/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efa4 expref: 6 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.075778:0:66733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a511516800) 00010000:00010000:3.0:1767316171.075780:0:66733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1767316171.075784:0:66733:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a5313e0e00, rc 0) 00000100:00100000:3.0:1767316171.075856:0:66733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a537f7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+6:33229:x1853164331491072:12345-192.168.203.1@tcp:101:rm.0 Request processed in 329us (6223us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316171.075863:0:66733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 288 00000100:00100000:2.0:1767316171.095593:0:32732:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316171.095731:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331491328 00000100:00100000:0.0:1767316171.095742:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331491328 00000100:00100000:0.0:1767316171.095798:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 289 00000100:00100000:0.0:1767316171.095814:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a534e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+6:33229:x1853164331491328:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:0.0:1767316171.095834:0:66756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1767316171.095861:0:66756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac600/0x1c4382d255f6fbad lrc: 2/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37efab expref: -99 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.095960:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fbb4 lrc: 3/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.095974:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fbb4 lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.095986:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fbb4 lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT1 00000004:00200000:0.0:1767316171.095997:0:66756:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1767316171.096104:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac600/0x1c4382d255f6fbad lrc: 0/0,0 mode: --/CR res: [0x200001b72:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efab expref: 9 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.096125:0:66756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fbb4 lrc: 3/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efab expref: 8 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.096133:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a511516800) 00010000:00010000:0.0:1767316171.096146:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1767316171.096150:0:66756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52aaaca00, rc 0) 00000100:00100000:0.0:1767316171.096205:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a534e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+8:33229:x1853164331491328:12345-192.168.203.1@tcp:101:rm.0 Request processed in 397us (615us total) trans 17179869282 rc 0/0 00000100:00100000:0.0:1767316171.096212:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 289 00000100:00100000:3.0:1767316171.106484:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1767316171.106556:0:66736:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331491456 00000100:00100000:2.0:1767316171.106570:0:66736:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331491456 00000100:00100000:2.0:1767316171.106641:0:66736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 29 00000100:00100000:2.0:1767316171.106666:0:66736:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5314b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:33229:x1853164331491456:12345-192.168.203.1@tcp:37:rm.0 00000100:00100000:0.0:1767316171.112625:0:66736:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5314b2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:33229:x1853164331491456:12345-192.168.203.1@tcp:37:rm.0 Request processed in 5950us (6175us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316171.112723:0:66736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 29 00000100:00100000:3.0:1767316171.123683:0:32732:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:2.0:1767316171.123787:0:66733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331491584 00000100:00100000:2.0:1767316171.123807:0:66733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331491584 00000100:00100000:2.0:1767316171.123896:0:66733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 290 00000100:00100000:2.0:1767316171.123908:0:66733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+9:33229:x1853164331491584:12345-192.168.203.1@tcp:41:rm.0 00000004:00000024:2.0:1767316171.123975:0:66733:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 638038016 avail 582414336 00000100:00100000:2.0:1767316171.124070:0:66733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bba9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+9:33229:x1853164331491584:12345-192.168.203.1@tcp:41:rm.0 Request processed in 164us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316171.124077:0:66733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 290 00000100:00100000:3.0:1767316171.128581:0:32730:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:0.0:1767316171.128787:0:66756:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331491712 00000100:00100000:0.0:1767316171.128798:0:66756:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331491712 00000100:00100000:0.0:1767316171.128861:0:66756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 291 00000100:00100000:0.0:1767316171.128886:0:66756:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+8:33229:x1853164331491712:12345-192.168.203.1@tcp:101:rm.0 00010000:00010000:0.0:1767316171.128907:0:66756:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1767316171.128927:0:66756:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac600/0x1c4382d255f6fbc2 lrc: 2/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdb4bedfb3a37efb2 expref: -99 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.129004:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad200/0x1c4382d255f6fbc9 lrc: 3/1,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.129017:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad200/0x1c4382d255f6fbc9 lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129027:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad200/0x1c4382d255f6fbc9 lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129041:0:66756:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac800/0x1c4382d255f6fbd0 lrc: 3/1,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66756 initiator: MDT0 00010000:00010000:0.0:1767316171.129048:0:66756:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac800/0x1c4382d255f6fbd0 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129053:0:66756:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac800/0x1c4382d255f6fbd0 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129182:0:66756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad200/0x1c4382d255f6fbc9 lrc: 3/1,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129189:0:66756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad200/0x1c4382d255f6fbc9 lrc: 2/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129195:0:66756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad200/0x1c4382d255f6fbc9 lrc: 3/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129202:0:66756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52aaad200 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:0.0:1767316171.129206:0:66756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad200/0x1c4382d255f6fbc9 lrc: 3/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129218:0:66756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad200/0x1c4382d255f6fbc9 lrc: 4/0,0 mode: CR/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129229:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a511516800) 00010000:00010000:0.0:1767316171.129232:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316171.129238:0:66756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad200/0x1c4382d255f6fbc9 lrc: 2/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129244:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaad200/0x1c4382d255f6fbc9 lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129255:0:66756:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac800/0x1c4382d255f6fbd0 lrc: 3/1,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129260:0:66756:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac800/0x1c4382d255f6fbd0 lrc: 2/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129266:0:66756:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac800/0x1c4382d255f6fbd0 lrc: 3/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129271:0:66756:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a52aaac800 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:0.0:1767316171.129274:0:66756:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac800/0x1c4382d255f6fbd0 lrc: 3/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129279:0:66756:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac800/0x1c4382d255f6fbd0 lrc: 4/0,0 mode: PR/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129285:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0xd49b5cf7 (ffff93a505285100) 00010000:00010000:0.0:1767316171.129288:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316171.129290:0:66756:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac800/0x1c4382d255f6fbd0 lrc: 2/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129296:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac800/0x1c4382d255f6fbd0 lrc: 0/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0xd49b5cf7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66756 initiator: MDT1 00010000:00010000:0.0:1767316171.129329:0:66756:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac600/0x1c4382d255f6fbc2 lrc: 1/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efb2 expref: 9 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.129338:0:66756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a511516800) 00010000:00010000:0.0:1767316171.129341:0:66756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316171.129344:0:66756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaac600/0x1c4382d255f6fbc2 lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efb2 expref: 9 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.129352:0:66756:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52aaac600, rc 0) 00000100:00100000:0.0:1767316171.129418:0:66756:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bba9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:efcdf44b-f089-4822-b0f8-a05beb18178a+8:33229:x1853164331491712:12345-192.168.203.1@tcp:101:rm.0 Request processed in 534us (846us total) trans 0 rc 301/301 00000100:00100000:0.0:1767316171.129426:0:66756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 291 00000100:00100000:3.0:1767316171.132420:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1767316171.132844:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:1.0:1767316171.132921:0:48857:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331491840 00000100:00100000:1.0:1767316171.132932:0:48857:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331491840 00000100:00100000:1.0:1767316171.132999:0:48857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 81 00000100:00100000:1.0:1767316171.133010:0:48857:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a50d8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:efcdf44b-f089-4822-b0f8-a05beb18178a+9:13816:x1853164331491840:12345-192.168.203.1@tcp:103:rm.0 00010000:00010000:1.0:1767316171.133025:0:48857:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1767316171.133062:0:48857:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaadc00/0x1c4382d255f6fb98 lrc: 0/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef9d expref: 9 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316171.133082:0:48857:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505285e00) 00010000:00010000:1.0:1767316171.133092:0:48857:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1767316171.133160:0:48857:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a50d8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:efcdf44b-f089-4822-b0f8-a05beb18178a+8:13816:x1853164331491840:12345-192.168.203.1@tcp:103:rm.0 Request processed in 151us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316171.133167:0:48857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 81 00000100:00100000:0.0:1767316171.139183:0:66736:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331492096 00000100:00100000:0.0:1767316171.139201:0:66736:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331492096 00000100:00100000:0.0:1767316171.139319:0:66736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 30 00000100:00100000:0.0:1767316171.139330:0:66736:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:33229:x1853164331492096:12345-192.168.203.1@tcp:35:rm.0 00000100:00100000:0.0:1767316171.139772:0:66736:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bba9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+9:33229:x1853164331492096:12345-192.168.203.1@tcp:35:rm.0 Request processed in 442us (7359us total) trans 17179869283 rc 0/0 00000100:00100000:0.0:1767316171.139781:0:66736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 30 00000100:00100000:3.0:1767316171.142873:0:32731:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1767316171.142915:0:66733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331492352 00000100:00100000:3.0:1767316171.142925:0:66733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331492352 00000100:00100000:3.0:1767316171.142972:0:66733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 292 00000100:00100000:3.0:1767316171.142982:0:66733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+9:33229:x1853164331492352:12345-192.168.203.1@tcp:36:rm.0 00010000:00010000:3.0:1767316171.143040:0:66733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1767316171.143063:0:66733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a52aaaca00/0x1c4382d255f6fbb4 lrc: 0/0,0 mode: --/CR res: [0x2400013a1:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efab expref: 9 pid: 66756 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.143085:0:66733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e0e00/0x1c4382d255f6fba6 lrc: 0/0,0 mode: --/PR res: [0x2400013a1:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37efa4 expref: 8 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.143116:0:66733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a511516800) 00010000:00010000:3.0:1767316171.143126:0:66733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1767316171.143183:0:66733:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 3/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66733 initiator: MDT0 00010000:00010000:3.0:1767316171.143192:0:66733:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 3/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66733 initiator: MDT1 00010000:00010000:3.0:1767316171.143202:0:66733:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 3/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66733 initiator: MDT1 00000100:00100000:3.0:1767316171.143223:0:66733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bba8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66733:1853164419083136:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1767316171.143267:0:66733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316171.143299:0:66733:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a51fdd3300 going to sleep for 11 seconds 00000100:00100000:3.0:1767316171.146526:0:48355:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419083136 00000100:00100000:3.0:1767316171.146542:0:48355:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419083136 00000100:00100000:3.0:1767316171.146613:0:48355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1767316171.146622:0:48355:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bbab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+6:66733:x1853164419083136:12345-0@lo:101:mdt00_001.0 00010000:00010000:3.0:1767316171.146653:0:48355:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1767316171.146675:0:48355:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e0a00/0x1c4382d255f6fbde lrc: 2/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c4382d255f6fbd7 expref: -99 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.146708:0:48355:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5400/0x1c4382d255f6fb7c lrc: 2/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef96 expref: 7 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.146717:0:48355:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e0a00/0x1c4382d255f6fbde lrc: 4/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1c4382d255f6fbd7 expref: 7 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.146762:0:48355:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5400/0x1c4382d255f6fb7c lrc: 3/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef96 expref: 7 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.146791:0:48355:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5400/0x1c4382d255f6fb7c lrc: 4/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef96 expref: 7 pid: 66733 timeout: 1473 lvb_type: 0 00000100:00100000:3.0:1767316171.146805:0:48355:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bba8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:48355:1853164419083264:192.168.203.1@tcp:104: 00000100:00100000:3.0:1767316171.146887:0:48355:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a506074600 going to sleep for 11 seconds 00000100:00100000:3.0:1767316171.151000:0:32732:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.1@tcp (source: 12345-192.168.203.1@tcp) 00000100:00100000:3.0:1767316171.151033:0:41155:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164331492480 00000100:00100000:3.0:1767316171.151042:0:41155:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164331492480 00010000:00010000:3.0:1767316171.151080:0:41155:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5400/0x1c4382d255f6fb7c lrc: 5/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef96 expref: 8 pid: 66733 timeout: 1473 lvb_type: 0 00000100:00100000:3.0:1767316171.151122:0:41155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.1@tcp, seq: 870 00000100:00100000:3.0:1767316171.151131:0:41155:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+8:13815:x1853164331492480:12345-192.168.203.1@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1767316171.151157:0:41155:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1767316171.151163:0:41155:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5400/0x1c4382d255f6fb7c lrc: 5/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef96 expref: 8 pid: 66733 timeout: 1473 lvb_type: 0 00010000:00010000:3.0:1767316171.151176:0:41155:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5400/0x1c4382d255f6fb7c lrc: 4/0,0 mode: PR/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef96 expref: 8 pid: 66733 timeout: 1473 lvb_type: 0 00010000:00010000:3.0:1767316171.151199:0:41155:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:3.0:1767316171.151207:0:41155:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e0a00/0x1c4382d255f6fbde lrc: 3/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1c4382d255f6fbd7 expref: 7 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.151218:0:41155:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e0a00/0x1c4382d255f6fbde lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x1c4382d255f6fbd7 expref: 7 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.151243:0:41155:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e0a00/0x1c4382d255f6fbde lrc: 4/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x50080000000000 nid: 0@lo remote: 0x1c4382d255f6fbd7 expref: 7 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.151278:0:41155:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e0a00/0x1c4382d255f6fbde lrc: 4/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6fbd7 expref: 7 pid: 48355 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1767316171.151292:0:41155:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bba9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:41155:1853164419083392:0@lo:105: 00000100:00100000:3.0:1767316171.151335:0:41155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316171.151368:0:41155:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a508b883c0 going to sleep for 11 seconds 00000100:00100000:3.0:1767316171.151385:0:41154:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419083392 00000100:00100000:3.0:1767316171.151388:0:41154:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419083392 00000100:00100000:3.0:1767316171.151416:0:41154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1767316171.151422:0:41154:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bbaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:41155:x1853164419083392:12345-0@lo:105: 00010000:00010000:3.0:1767316171.151432:0:41154:0:(ldlm_lockd.c:2517:ldlm_callback_handler()) ### completion ast ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 4/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.151468:0:41154:0:(ldlm_lockd.c:1967:ldlm_handle_cp_callback()) ### client completion callback handler START ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 4/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.151477:0:41154:0:(ldlm_lockd.c:2044:ldlm_handle_cp_callback()) ### completion AST, new policy data ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 4/0,1 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.151484:0:41154:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 4/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316171.151786:0:48355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5400/0x1c4382d255f6fb7c lrc: 0/0,0 mode: --/PR res: [0x200001b72:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.1@tcp remote: 0xdb4bedfb3a37ef96 expref: 8 pid: 66733 timeout: 1473 lvb_type: 0 00000100:00100000:2.0:1767316171.151801:0:48355:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bba8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000_UUID:48355:1853164419083264:192.168.203.1@tcp:104: 00010000:00010000:2.0:1767316171.151823:0:48355:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e0a00/0x1c4382d255f6fbde lrc: 4/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6fbd7 expref: 7 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1767316171.151831:0:48355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:2.0:1767316171.151834:0:48355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1767316171.151837:0:48355:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a5313e0a00, rc 0) 00000100:00100000:2.0:1767316171.151879:0:48355:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bbab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66733:x1853164419083136:12345-0@lo:101:mdt00_001.0 Request processed in 5257us (8611us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316171.151887:0:48355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00010000:00010000:3.0:1767316171.152972:0:41154:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 5/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11080000000000 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.152998:0:41154:0:(ldlm_lockd.c:2072:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 5/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1080000000000 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.153014:0:41154:0:(ldlm_lockd.c:2083:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff93a5313e0000) 00000100:00100000:3.0:1767316171.153072:0:41154:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bbaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0001-mdtlov_UUID+4:41155:x1853164419083392:12345-0@lo:105: Request processed in 1648us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316171.153080:0:41154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1767316171.153125:0:66733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bba8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66733:1853164419083136:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1767316171.153150:0:66733:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 4/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1767316171.153169:0:66733:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200001b72:0x1:0x0] 00010000:00010000:3.0:1767316171.153204:0:66733:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 3/0,1 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66733 initiator: MDT0 00010000:00010000:3.0:1767316171.153211:0:66733:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 3/0,1 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66733 initiator: MDT1 00010000:00010000:3.0:1767316171.153220:0:66733:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 3/0,1 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66733 initiator: MDT1 00000100:00100000:3.0:1767316171.153237:0:66733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bba8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66733:1853164419083520:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1767316171.153265:0:66733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316171.153294:0:66733:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a508b88f00 going to sleep for 11 seconds 00000100:00100000:0.0:1767316171.153510:0:48355:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419083520 00000100:00100000:0.0:1767316171.153516:0:48355:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419083520 00000100:00100000:0.0:1767316171.153553:0:48355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1767316171.153562:0:48355:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+7:66733:x1853164419083520:12345-0@lo:101:mdt00_001.0 00010000:00010000:0.0:1767316171.153576:0:48355:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1767316171.153591:0:48355:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad000/0x1c4382d255f6fbec lrc: 2/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c4382d255f6fbe5 expref: -99 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.153623:0:48355:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad000/0x1c4382d255f6fbec lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1c4382d255f6fbe5 expref: 8 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.153646:0:48355:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad000/0x1c4382d255f6fbec lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6fbe5 expref: 8 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.153654:0:48355:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0xc4959c6c (ffff93a505285d00) 00010000:00010000:0.0:1767316171.153657:0:48355:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1767316171.153660:0:48355:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a52aaad000, rc 0) 00000100:00100000:0.0:1767316171.153693:0:48355:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bba8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66733:x1853164419083520:12345-0@lo:101:mdt00_001.0 Request processed in 133us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316171.153699:0:48355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1767316171.153957:0:41155:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bba9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-MDT0000_UUID:41155:1853164419083392:0@lo:105: 00010000:00010000:2.0:1767316171.153970:0:41155:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1767316171.154021:0:41155:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bba8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:efcdf44b-f089-4822-b0f8-a05beb18178a+7:13815:x1853164331492480:12345-192.168.203.1@tcp:103:ldlm_bl.0 Request processed in 2890us (3030us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316171.154039:0:41155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 870 00000100:00100000:3.0:1767316171.155369:0:66733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bba8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66733:1853164419083520:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1767316171.155394:0:66733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 4/0,1 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1c4382d255f6fbec expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.155424:0:66733:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 4/0,1 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fbec expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1767316171.156201:0:66733:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200001b72:0x1:0x0] 00000100:00100000:3.0:1767316171.156257:0:66733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bba8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66733:1853164419083648:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1767316171.156314:0:66733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316171.156340:0:66733:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a508b883c0 going to sleep for 11 seconds 00000100:00100000:1.0:1767316171.156399:0:48844:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419083648 00000100:00100000:1.0:1767316171.156406:0:48844:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419083648 00000100:00100000:0.0:1767316171.156757:0:48355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1767316171.156768:0:48355:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40bba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66733:x1853164419083648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1767316171.156841:0:48355:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bba9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66733:x1853164419083648:12345-0@lo:1000:mdt00_001.0 Request processed in 75us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316171.156848:0:48355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:3.0:1767316171.156922:0:66733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bba8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66733:1853164419083648:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1767316171.156966:0:66733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bba8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66733:1853164419083776:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1767316171.156988:0:66733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316171.157008:0:66733:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a508b88f00 going to sleep for 11 seconds 00000100:00100000:0.0:1767316171.157214:0:48355:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419083776 00000100:00100000:0.0:1767316171.157219:0:48355:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419083776 00000100:00100000:0.0:1767316171.157253:0:48355:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1767316171.157259:0:48355:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a539b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66733:x1853164419083776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1767316171.157331:0:48355:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a539b5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66733:x1853164419083776:12345-0@lo:1000:mdt00_001.0 Request processed in 72us (342us total) trans 0 rc 1/1 00000100:00100000:0.0:1767316171.157337:0:48355:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1767316171.157428:0:66733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bba8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66733:1853164419083776:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1767316171.157526:0:66733:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 3/0,1 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x10000000000000 pid: 66733 initiator: MDT0 00010000:00010000:3.0:1767316171.157536:0:66733:0:(ldlm_request.c:1022:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 3/0,1 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x0 pid: 66733 initiator: MDT1 00010000:00010000:3.0:1767316171.157545:0:66733:0:(ldlm_request.c:1109:ldlm_cli_enqueue()) ### sending request ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 3/0,1 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT flags: 0x1000000000000 pid: 66733 initiator: MDT1 00000100:00100000:3.0:1767316171.157558:0:66733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40bba8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66733:1853164419083904:0@lo:101:mdt00_001.0 00000100:00100000:3.0:1767316171.157611:0:66733:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316171.157627:0:66733:0:(client.c:2690:ptlrpc_set_wait()) set ffff93a508b88f00 going to sleep for 11 seconds 00000100:00100000:1.0:1767316171.157686:0:44073:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419083904 00000100:00100000:1.0:1767316171.157691:0:44073:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419083904 00000100:00100000:1.0:1767316171.157718:0:44073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:1.0:1767316171.157724:0:44073:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+8:66733:x1853164419083904:12345-0@lo:101:mdt00_001.0 00010000:00010000:1.0:1767316171.157732:0:44073:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1767316171.157760:0:44073:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5800/0x1c4382d255f6fbfa lrc: 2/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1c4382d255f6fbf3 expref: -99 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316171.157782:0:44073:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5800/0x1c4382d255f6fbfa lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 0@lo remote: 0x1c4382d255f6fbf3 expref: 9 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316171.157795:0:44073:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5800/0x1c4382d255f6fbfa lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 0@lo remote: 0x1c4382d255f6fbf3 expref: 9 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1767316171.157804:0:44073:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505e42200) 00010000:00010000:1.0:1767316171.157807:0:44073:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1767316171.157810:0:44073:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93a4010f5800, rc 0) 00000100:00100000:1.0:1767316171.157848:0:44073:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506d2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0001-mdtlov_UUID+9:66733:x1853164419083904:12345-0@lo:101:mdt00_001.0 Request processed in 124us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1767316171.157863:0:44073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1767316171.158167:0:66733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40bba8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-mdtlov_UUID:66733:1853164419083904:0@lo:101:mdt00_001.0 00010000:00010000:3.0:1767316171.158179:0:66733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 4/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000000000000 nid: local remote: 0x1c4382d255f6fbfa expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.158203:0:66733:0:(ldlm_request.c:784:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 4/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fbfa expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.158228:0:66733:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fc01 lrc: 3/0,1 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 66733 initiator: MDT0 00010000:00010000:3.0:1767316171.158236:0:66733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fc01 lrc: 3/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66733 initiator: MDT1 00010000:00010000:3.0:1767316171.158243:0:66733:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fc01 lrc: 3/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 66733 initiator: MDT1 00010000:00010000:3.0:1767316171.158323:0:66733:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fc01 lrc: 3/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 66733 initiator: MDT1 00010000:00010000:3.0:1767316171.158330:0:66733:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fc01 lrc: 2/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 66733 initiator: MDT1 00010000:00010000:3.0:1767316171.158335:0:66733:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fc01 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66733 initiator: MDT1 00010000:00010000:3.0:1767316171.158340:0:66733:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a5313e1e00 already unused, calling callback (ffffffffc17dc550) 00010000:00010000:3.0:1767316171.158344:0:66733:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fc01 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 66733 initiator: MDT1 00010000:00010000:3.0:1767316171.158351:0:66733:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fc01 lrc: 4/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 66733 initiator: MDT1 00010000:00010000:3.0:1767316171.158359:0:66733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a511516c00) 00010000:00010000:3.0:1767316171.158361:0:66733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1767316171.158364:0:66733:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fc01 lrc: 2/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66733 initiator: MDT1 00010000:00010000:3.0:1767316171.158379:0:66733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0001_UUID lock: ffff93a5313e1e00/0x1c4382d255f6fc01 lrc: 0/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 66733 initiator: MDT1 00010000:00010000:3.0:1767316171.158395:0:66733:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 4/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fbfa expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.158402:0:66733:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 4/0,1 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fbfa expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.158408:0:66733:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fbfa expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.158433:0:66733:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1767316171.158467:0:66733:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200001b72:0x1:0x0] 00010000:00010000:3.0:1767316171.158474:0:66733:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 4/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.158480:0:66733:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 4/0,1 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.158487:0:66733:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.158497:0:66733:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1767316171.158501:0:66733:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200001b72:0x1:0x0] 00010000:00010000:3.0:1767316171.158504:0:66733:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 4/0,1 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000000000000 nid: local remote: 0x1c4382d255f6fbec expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.158512:0:66733:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 4/0,1 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fbec expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.158528:0:66733:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x11000400000000 nid: local remote: 0x1c4382d255f6fbec expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.158992:0:66733:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:3.0:1767316171.159063:0:66733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40bba9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:efcdf44b-f089-4822-b0f8-a05beb18178a+7:33229:x1853164331492352:12345-192.168.203.1@tcp:36:rm.0 Request processed in 16080us (16196us total) trans 0 rc -39/-39 00000100:00100000:3.0:1767316171.159070:0:66733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.1@tcp, seq: 292 00010000:00010000:0.0:1767316171.159800:0:41159:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1767316171.159810:0:41159:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 2/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1c4382d255f6fbfa expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.159831:0:41159:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a5313e0200 already unused, calling callback (ffffffffc17e9290) 00010000:00010000:0.0:1767316171.159836:0:41159:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1c4382d255f6fbfa expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1767316171.159845:0:41159:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 3/0,0 mode: EX/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1c4382d255f6fbfa expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.159876:0:41159:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 2/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fbfa expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.159882:0:41159:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316171.159912:0:41159:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 1/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fbfa expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.159919:0:41159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0200/0x1c4382d255f6fbf3 lrc: 0/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fbfa expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.159935:0:41159:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1767316171.159938:0:41159:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 2/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.159944:0:41159:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a5313e0000 already unused, calling callback (ffffffffc17e9290) 00010000:00010000:0.0:1767316171.159947:0:41159:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1767316171.159954:0:41159:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 3/0,0 mode: CW/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.159970:0:41159:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 2/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.159981:0:41159:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316171.160000:0:41159:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 1/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.160007:0:41159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0000/0x1c4382d255f6fbd7 lrc: 0/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fbde expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.160018:0:41159:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1767316171.160022:0:41159:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 2/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1000400000000 nid: local remote: 0x1c4382d255f6fbec expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.160028:0:41159:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff93a5313e0600 already unused, calling callback (ffffffffc17e9290) 00010000:00010000:0.0:1767316171.160031:0:41159:0:(ldlm_request.c:1285:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1008400000000 nid: local remote: 0x1c4382d255f6fbec expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00000004:00010000:0.0:1767316171.160038:0:41159:0:(mdt_handler.c:3944:mdt_remote_blocking_ast()) ### Revoke remote lock ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 3/0,0 mode: PW/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x1009400000000 nid: local remote: 0x1c4382d255f6fbec expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.160054:0:41159:0:(ldlm_request.c:1332:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 2/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fbec expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.160060:0:41159:0:(ldlm_request.c:1378:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1767316171.160065:0:41159:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 1/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fbec expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.160071:0:41159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-osp-MDT0001 lock: ffff93a5313e0600/0x1c4382d255f6fbe5 lrc: 0/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x5809400000020 nid: local remote: 0x1c4382d255f6fbec expref: -99 pid: 66733 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1767316171.160083:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316171.160091:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316171.160093:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1767316171.160102:0:32739:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1767316171.160119:0:32739:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a537f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:32739:1853164419084032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1767316171.160201:0:32739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316171.160564:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419084160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1767316171.160606:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316171.160643:0:32737:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1767316171.160648:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419084288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1767316171.160668:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316171.160695:0:41157:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419084032 00000100:00100000:3.0:1767316171.160701:0:41157:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419084032 00000100:00100000:3.0:1767316171.160750:0:41157:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419084160 00000100:00100000:3.0:1767316171.160754:0:41157:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419084160 00000100:00100000:3.0:1767316171.160773:0:41157:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419084288 00000100:00100000:3.0:1767316171.160775:0:41157:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419084288 00000100:00100000:3.0:1767316171.160795:0:41157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1767316171.160802:0:41157:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5054e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+11:32739:x1853164419084032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1767316171.160814:0:41157:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1767316171.160832:0:41157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a4010f5800/0x1c4382d255f6fbfa lrc: 0/0,0 mode: --/EX res: [0x2400013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1c4382d255f6fbf3 expref: 11 pid: 44073 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.160845:0:41157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400013a1:0x1:0x0].0x0 (ffff93a505e42200) 00010000:00010000:3.0:1767316171.160853:0:41157:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1767316171.160892:0:41157:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5054e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+10:32739:x1853164419084032:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316171.160900:0:41157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1767316171.160915:0:41157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1767316171.160921:0:41157:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+9:32737:x1853164419084160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1767316171.160928:0:41157:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1767316171.160938:0:41157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a5313e0a00/0x1c4382d255f6fbde lrc: 0/0,0 mode: --/CW res: [0x200001b72:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1c4382d255f6fbd7 expref: 9 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.160948:0:41157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0x0 (ffff93a507766400) 00010000:00010000:3.0:1767316171.160952:0:41157:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1767316171.160978:0:41157:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506d2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+8:32737:x1853164419084160:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316171.160983:0:41157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1767316171.160996:0:41157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1767316171.161001:0:41157:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506d2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+7:32737:x1853164419084288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1767316171.161009:0:41157:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1767316171.161019:0:41157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93a52aaad000/0x1c4382d255f6fbec lrc: 0/0,0 mode: --/PW res: [0x200001b72:0x1:0x0].0xc4959c6c bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 0@lo remote: 0x1c4382d255f6fbe5 expref: 7 pid: 48355 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1767316171.161029:0:41157:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b72:0x1:0x0].0xc4959c6c (ffff93a505285d00) 00010000:00010000:3.0:1767316171.161036:0:41157:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1767316171.161056:0:41157:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506d2d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:lustre-MDT0001-mdtlov_UUID+6:32737:x1853164419084288:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316171.161062:0:41157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1767316171.161106:0:32739:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a537f7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:32739:1853164419084032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1767316171.161131:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419084288:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1767316171.161164:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:32737:1853164419084160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1767316171.161588:0:46026:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1767316171.161727:0:41158:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1767316171.478929:0:32740:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1767316171.478950:0:32740:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a506d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419084416:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1767316171.479035:0:32740:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1767316171.479087:0:57170:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419084416 00000100:00100000:3.0:1767316171.479096:0:57170:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419084416 00000100:00100000:3.0:1767316171.479154:0:57170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1767316171.479162:0:57170:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:32740:x1853164419084416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1767316171.479190:0:57170:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 266560 pending 0 free 319000576 avail 291188736 00000100:00100000:3.0:1767316171.479232:0:57170:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506d2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:32740:x1853164419084416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1767316171.479240:0:57170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1767316171.479289:0:32740:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a506d2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:32740:1853164419084416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1767316171.480281:0:32739:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1767316171.480295:0:32739:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a5054e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:32739:1853164419084544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1767316171.480340:0:32739:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316171.480427:0:44065:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419084544 00000100:00100000:2.0:1767316171.480433:0:44065:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419084544 00000100:00100000:2.0:1767316171.480501:0:44065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1767316171.480508:0:44065:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a5054e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:32739:x1853164419084544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1767316171.480530:0:44065:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 266560 pending 0 free 319037440 avail 291225600 00000100:00100000:2.0:1767316171.480576:0:44065:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a5054e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:32739:x1853164419084544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1767316171.480583:0:44065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1767316171.480619:0:32739:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a5054e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:32739:1853164419084544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1767316171.480728:0:32738:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1767316171.480739:0:32738:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40ac4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:32738:1853164419084672:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1767316171.480768:0:32738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1767316171.480856:0:32737:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1767316171.480865:0:32737:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff93a40ac49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:32737:1853164419084800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1767316171.481430:0:32737:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1767316171.486071:0:57170:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419084672 00000100:00100000:0.0:1767316171.486086:0:57170:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419084672 00000100:00100000:0.0:1767316171.486177:0:57170:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1853164419084800 00000100:00100000:0.0:1767316171.486182:0:57170:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1853164419084800 00000100:00100000:0.0:1767316171.486203:0:57170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1767316171.486212:0:57170:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a506d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:32738:x1853164419084672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1767316171.486236:0:57170:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 266560 pending 0 free 319000576 avail 291188736 00000100:00100000:0.0:1767316171.486308:0:57170:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a506d2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:32738:x1853164419084672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (5539us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316171.486316:0:57170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1767316171.486333:0:57170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1767316171.486339:0:57170:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff93a40ac4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:32737:x1853164419084800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1767316171.486349:0:57170:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 266560 pending 0 free 319037440 avail 291225600 00000100:00100000:0.0:1767316171.486381:0:57170:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff93a40ac4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:32737:x1853164419084800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (4953us total) trans 0 rc 0/0 00000100:00100000:0.0:1767316171.486388:0:57170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1767316171.486429:0:32737:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40ac49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:32737:1853164419084800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1767316171.488270:0:32738:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff93a40ac4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:32738:1853164419084672:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1767316171.674856:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1767316172.695812:0:46026:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1767316173.001089:0:70709:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-scrub test_4c: @@@@@@ FAIL: Fail to cleanup the env! 00010000:00010000:2.0:1767316173.718599:0:41158:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1767316174.745798:0:41159:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 672 lines, 672 kept, 0 dropped, 0 bad.