00010000:00010000:0.0F:1789428073.203105:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428074.230822:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0F:1789428075.251144:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0F:1789428075.459902:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428075.460015:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931709952 00000100:00100000:0.0:1789428075.460025:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931709952 00000100:00100000:0.0:1789428075.460097:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:0.0:1789428075.460108:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+22:15553:x1876350931709952:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789428075.460260:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+22:15553:x1876350931709952:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 Request processed in 155us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428075.460268:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00080000:1.0F:1789428075.460569:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789428075.465604:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428075.465812:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931710080 00000100:00100000:2.0:1789428075.465822:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931710080 00000100:00100000:2.0:1789428075.465960:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:2.0:1789428075.465970:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:15553:x1876350931710080:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789428075.466071:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:15553:x1876350931710080:12345-192.168.202.24@tcp:60:lhsmtool_posix.0 Request processed in 104us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428075.466077:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00080000:1.0:1789428075.466459:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789428075.472038:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428075.472655:0:17162:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931710336 00000100:00100000:1.0:1789428075.472667:0:17162:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931710336 00000100:00100000:1.0:1789428075.472759:0:17162:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:1.0:1789428075.472769:0:17162:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+22:15553:x1876350931710336:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789428075.473007:0:17162:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+23:15553:x1876350931710336:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 237us (976us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1789428075.473015:0:17162:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:3.0:1789428075.824646:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940162944:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789428075.824730:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428075.824795:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940163072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789428075.824835:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428075.824873:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940162944 00000100:00100000:2.0:1789428075.824883:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940162944 00000100:00100000:0.0:1789428075.824889:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940163072 00000100:00100000:0.0:1789428075.824896:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940163072 00000100:00100000:0.0:1789428075.824949:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789428075.824965:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940163072:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789428075.824989:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789428075.824999:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789428075.825059:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940163072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428075.825134:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940163072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789428075.833252:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789428075.833315:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789428075.833348:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940162944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789428075.833377:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789428075.833498:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940162944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (8769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428075.833504:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789428075.833659:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940162944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789428076.012509:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428076.012557:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428076.012577:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428076.012613:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428076.012647:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428076.012667:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428076.012688:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428076.012716:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931710592 00000100:00100000:0.0:1789428076.012725:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931710592 00000100:00100000:0.0:1789428076.012771:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931711104 00000100:00100000:0.0:1789428076.012774:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931711104 00000100:00100000:0.0:1789428076.012787:0:18663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931710720 00000100:00100000:0.0:1789428076.012789:0:18663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931710720 00000100:00100000:3.0:1789428076.012799:0:18820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931711232 00000100:00100000:3.0:1789428076.012807:0:18820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931711232 00000100:00100000:0.0:1789428076.012810:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:0.0:1789428076.012821:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2394:x1876350931710592:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789428076.012842:0:18820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1789428076.012852:0:18820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2394:x1876350931711104:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789428076.012892:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2394:x1876350931710592:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 72us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428076.012893:0:18820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2394:x1876350931711104:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 42us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428076.012905:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:3.0:1789428076.012918:0:18820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:1.0:1789428076.012983:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931710848 00000100:00100000:1.0:1789428076.012987:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931710848 00000100:00100000:1.0:1789428076.013014:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931710976 00000100:00100000:1.0:1789428076.013016:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931710976 00000100:00100000:1.0:1789428076.013036:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:1.0:1789428076.013043:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2394:x1876350931710848:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789428076.013069:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2394:x1876350931710848:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428076.013075:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:1.0:1789428076.013088:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:1.0:1789428076.013093:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2394:x1876350931710976:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789428076.013123:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2394:x1876350931710976:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 30us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428076.013133:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:0.0:1789428076.013241:0:18663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:0.0:1789428076.013250:0:18663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2394:x1876350931710720:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789428076.013275:0:18663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2394:x1876350931710720:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 27us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428076.013357:0:18820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:3.0:1789428076.013367:0:18820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2394:x1876350931711232:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789428076.013653:0:18820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2394:x1876350931711232:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 287us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428076.013660:0:18820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:3.0:1789428076.014219:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931710464 00000100:00100000:3.0:1789428076.014228:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931710464 00000100:00100000:3.0:1789428076.014265:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 165 00000100:00100000:3.0:1789428076.014273:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:2394:x1876350931710464:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789428076.014709:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:2394:x1876350931710464:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 435us (2093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428076.014718:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 165 00000100:00080000:1.0:1789428076.018605:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789428076.018616:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789428076.018621:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789428076.018625:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789428076.020332:0:18663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00010000:00010000:0.0:1789428076.274175:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428076.336842:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789428076.336866:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940163200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789428076.336939:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428076.337012:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940163200 00000100:00100000:2.0:1789428076.337021:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940163200 00000100:00100000:2.0:1789428076.337081:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789428076.337092:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940163200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789428076.337121:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789428076.337168:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940163200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428076.337175:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789428076.337474:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789428076.337510:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfae2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940163200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789428076.338064:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940163328:0@lo:400:kworker.0 00000100:00100000:0.0:1789428076.338110:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428076.338137:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940163840:0@lo:400:kworker.0 00000100:00100000:0.0:1789428076.338162:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428076.338179:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940164352:0@lo:400:kworker.0 00000100:00100000:0.0:1789428076.338203:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428076.338359:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940163328 00000100:00100000:3.0:1789428076.338376:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940163328 00000100:00100000:3.0:1789428076.338428:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789428076.338437:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3613:x1876350940163328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.338476:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3613:x1876350940163328:12345-0@lo:400:kworker.0 Request processed in 40us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428076.338483:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789428076.338513:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940163712:0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.338577:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428076.338597:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940164224:0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.338627:0:18820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940163840 00000100:00100000:3.0:1789428076.338631:0:18820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940163840 00000100:00100000:3.0:1789428076.338662:0:18820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789428076.338669:0:18820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940163840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.338700:0:18820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940163840:12345-0@lo:400:kworker.0 Request processed in 33us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428076.338707:0:18820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789428076.338726:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940163456:0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.338749:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428076.338765:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940163968:0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.338807:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940163712 00000100:00100000:3.0:1789428076.338811:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940163712 00000100:00100000:3.0:1789428076.338836:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940163456 00000100:00100000:3.0:1789428076.338839:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940163456 00000100:00100000:3.0:1789428076.338853:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789428076.338858:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940163712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.338895:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940163712:12345-0@lo:400:kworker.0 Request processed in 37us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428076.338908:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789428076.338919:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789428076.338924:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940163456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.338957:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940163456:12345-0@lo:400:kworker.0 Request processed in 32us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428076.338962:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789428076.339470:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940163328:0@lo:400:kworker.0 00000100:00100000:0.0:1789428076.339483:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940163840:0@lo:400:kworker.0 00000100:00100000:1.0:1789428076.339576:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940164352 00000100:00100000:1.0:1789428076.339581:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940164352 00000100:00100000:1.0:1789428076.339625:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789428076.339633:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940164352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428076.339670:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940164352:12345-0@lo:400:kworker.0 Request processed in 39us (1466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428076.339676:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789428076.339756:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428076.339794:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940163712:0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.339804:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789428076.339810:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940163584:0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.339833:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428076.339849:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940164096:0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.339866:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428076.339878:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940164608:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789428076.339897:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428076.339924:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940164224 00000100:00100000:3.0:1789428076.339928:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940164224 00000100:00100000:3.0:1789428076.339947:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940163584 00000100:00100000:3.0:1789428076.339950:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940163584 00000100:00100000:3.0:1789428076.339959:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940164096 00000100:00100000:3.0:1789428076.339961:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940164096 00000100:00100000:3.0:1789428076.339974:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789428076.339980:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940164224:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789428076.340004:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789428076.340009:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789428076.340012:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940164224:12345-0@lo:400:kworker.0 Request processed in 32us (256us total) trans 0 rc 0/0 00000100:00080000:2.0:1789428076.340012:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789428076.340017:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789428076.340034:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940164608 00000100:00100000:3.0:1789428076.340035:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789428076.340037:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940164608 00000100:00100000:3.0:1789428076.340041:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940163584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.340067:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940163584:12345-0@lo:400:kworker.0 Request processed in 27us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428076.340067:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789428076.340072:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789428076.340073:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940164608:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789428076.340082:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789428076.340087:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940164096:12345-0@lo:400:kworker.0 00002000:00000024:2.0:1789428076.340087:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789428076.340109:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1876350940164096:12345-0@lo:400:kworker.0 Request processed in 22us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428076.340114:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940164608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 43us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428076.340115:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789428076.340119:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789428076.340135:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428076.340137:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940163584:0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.340146:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3616:1876350940164096:0@lo:400:kworker.0 00000100:00100000:2.0:1789428076.340153:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940164480:0@lo:400:kworker.0 00000100:00100000:3.0:1789428076.340157:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940164608:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789428076.340168:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919688822d80 x1876350940164224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428076.340172:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428076.340179:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940164224:0@lo:400:kworker.0 00000100:00100000:2.0:1789428076.340191:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940163456:0@lo:400:kworker.0 00000100:00100000:2.0:1789428076.340215:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940163968 00000100:00100000:2.0:1789428076.340218:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940163968 00000100:00100000:2.0:1789428076.340234:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940164480 00000100:00100000:2.0:1789428076.340236:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940164480 00000100:00100000:2.0:1789428076.340255:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789428076.340261:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940163968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428076.340292:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940163968:12345-0@lo:400:kworker.0 Request processed in 31us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428076.340298:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789428076.340310:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789428076.340327:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940164480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428076.340354:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940164480:12345-0@lo:400:kworker.0 Request processed in 39us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428076.340360:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1789428076.340371:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789428076.340392:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940163968:0@lo:400:kworker.0 00010000:00080000:2.0:1789428076.340503:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919688823480 x1876350940164480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428076.340513:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940164480:0@lo:400:kworker.0 00000100:00100000:0.0:1789428076.340629:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940164352:0@lo:400:kworker.0 00000001:00080000:0.0:1789428076.342192:0:17139:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00010000:00010000:1.0:1789428076.342366:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519c06 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428076.342380:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519c06 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428076.342388:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519c06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428076.342395:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789428076.342400:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519c06 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428076.342409:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519c06 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428076.342461:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff919581d49d00) 00010000:00010000:1.0:1789428076.342464:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428076.342469:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519c06 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428076.342492:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208200/0x84fc867ede519c06 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17160 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789428076.342637:0:17139:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9196adc19780 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:0.0:1789428076.342642:0:17139:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9196988bf000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9195810d8b40 00000020:00080000:0.0:1789428076.342645:0:17139:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9196988bf400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9195826e4e00 00000020:00080000:2.0:1789428076.342725:0:17198:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:2.0:1789428076.342859:0:17198:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1789428076.785283:0:17192:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789428076.785291:0:17192:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789428076.785349:0:17192:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789428076.785360:0:17192:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:2.0:1789428077.030762:0:20532:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 19:21:15 (1789428075) 00010000:00010000:0.0:1789428077.297012:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428077.360960:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789428077.360990:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940164864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789428077.361013:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbb14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940164736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789428077.361379:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428077.361767:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940164864 00000100:00100000:3.0:1789428077.361779:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940164864 00000100:00100000:3.0:1789428077.361961:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789428077.361973:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940164864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789428077.362031:0:17164:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789428077.362105:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688820380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940164864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428077.362113:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789428077.362221:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940164864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789428077.363644:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428077.363816:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940164736 00000100:00100000:0.0:1789428077.363827:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940164736 00000100:00100000:0.0:1789428077.363874:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789428077.363884:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940164736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789428077.363932:0:17899:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:0.0:1789428077.364039:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940164736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428077.364046:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789428077.364174:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbb14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940164736:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789428078.256988:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789428078.321468:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428079.344722:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428080.119871:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428080.120012:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931711488 00000100:00100000:1.0:1789428080.120024:0:17163:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931711488 00000100:00100000:1.0:1789428080.120118:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:1.0:1789428080.120128:0:17163:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+13:16308:x1876350931711488:12345-192.168.202.24@tcp:35:umount.0 00000001:00080000:1.0:1789428080.120389:0:17163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1789428080.120516:0:17163:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:1.0:1789428080.120646:0:17163:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688823100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+16:16308:x1876350931711488:12345-192.168.202.24@tcp:35:umount.0 Request processed in 518us (783us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1789428080.120655:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000020:00080000:1.0:1789428080.120660:0:17163:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:2.0:1789428080.120742:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789428080.127757:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428080.127854:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931711744 00000100:00100000:2.0:1789428080.127864:0:17146:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931711744 00000100:00100000:2.0:1789428080.127928:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:2.0:1789428080.127938:0:17146:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:2394:x1876350931711744:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789428080.127955:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428080.127972:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f46800/0x84fc867ede519919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f35 expref: 13 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428080.127989:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428080.128050:0:17146:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:2394:x1876350931711744:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 114us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428080.128057:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:0.0:1789428080.130101:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428080.130143:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428080.130260:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931711616 00000100:00100000:3.0:1789428080.130288:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931711616 00000100:00100000:3.0:1789428080.130351:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931711872 00000100:00100000:3.0:1789428080.130356:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931711872 00000100:00100000:3.0:1789428080.130388:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:3.0:1789428080.130397:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bce68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+13:2396:x1876350931711616:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789428080.130438:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428080.130457:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428c00/0x84fc867ede519912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f04 expref: 13 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428080.130473:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428080.130519:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bce68850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:2396:x1876350931711616:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 124us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428080.130526:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:3.0:1789428080.130574:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:3.0:1789428080.130581:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:2396:x1876350931711872:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789428080.130588:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428080.130596:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91958375d000/0x84fc867ede51999e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300feb expref: 11 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428080.130606:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428080.130622:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688822680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:2396:x1876350931711872:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 42us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428080.130628:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:3.0:1789428080.133009:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428080.133089:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931712000 00000100:00100000:2.0:1789428080.133098:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931712000 00000100:00100000:2.0:1789428080.133170:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:2.0:1789428080.133191:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2393:x1876350931712000:12345-192.168.202.24@tcp:9:umount.0 00000020:00000080:2.0:1789428080.133221:0:18665:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51993c 00000100:00080000:2.0:1789428080.133236:0:18665:0:(import.c:65:import_set_state_nolock()) ffff9196bca07000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789428080.133307:0:18665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1789428080.133486:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+2:2393:x1876350931712000:12345-192.168.202.24@tcp:9:umount.0 Request processed in 295us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428080.133496:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31 00010000:00010000:3.0:1789428080.133621:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789428080.133784:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789428080.138638:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428080.138771:0:18820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931712128 00000100:00100000:0.0:1789428080.138781:0:18820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931712128 00000100:00100000:0.0:1789428080.138843:0:18820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:0.0:1789428080.138850:0:18820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2393:x1876350931712128:12345-192.168.202.24@tcp:9:umount.0 00000020:00000080:0.0:1789428080.138876:0:18820:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519935 00000100:00080000:0.0:1789428080.138891:0:18820:0:(import.c:65:import_set_state_nolock()) ffff9196bca01800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789428080.138943:0:18820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:2.0:1789428080.139171:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789428080.139203:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428080.139254:0:18820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+2:2393:x1876350931712128:12345-192.168.202.24@tcp:9:umount.0 Request processed in 404us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428080.139260:0:18820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:0.0:1789428080.144952:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428080.145589:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931713024 00000100:00100000:1.0:1789428080.145601:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931713024 00000100:00100000:1.0:1789428080.145706:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 67 00000100:00100000:1.0:1789428080.145716:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+16:2393:x1876350931713024:12345-192.168.202.24@tcp:39:umount.0 00000020:00000080:1.0:1789428080.145750:0:17159:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519927 00000020:00010000:1.0:1789428080.145764:0:17159:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9196bca05800: total 0 00000100:00080000:1.0:1789428080.145769:0:17159:0:(import.c:65:import_set_state_nolock()) ffff9196bca05000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789428080.145796:0:17159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:1.0:1789428080.145948:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+15:2393:x1876350931713024:12345-192.168.202.24@tcp:39:umount.0 Request processed in 232us (1004us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1789428080.145955:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 67 00000020:00010000:0.0:1789428080.146005:0:20182:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9196bca05800: total 0 00010000:00010000:0.0:1789428080.146076:0:20182:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9196bca05800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789428080.146110:0:20182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:0.0:1789428080.146114:0:20182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789428080.146121:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428600/0x84fc867ede519b50 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730105b expref: 14 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428080.146137:0:20182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:0.0:1789428080.146139:0:20182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789428080.146142:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208600/0x84fc867ede519c37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010a8 expref: 13 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428080.146153:0:20182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff919581d4ea00) 00010000:00010000:0.0:1789428080.146156:0:20182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428080.146176:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede519a0e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ff9 expref: 12 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428080.146197:0:20182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196989f7300) 00010000:00010000:0.0:1789428080.146199:0:20182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789428080.146203:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91958375de00/0x84fc867ede519a4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301007 expref: 11 pid: 17159 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428080.146227:0:20182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff919581d49d00) 00010000:00010000:0.0:1789428080.146230:0:20182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789428080.146235:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429200/0x84fc867ede519bdc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301085 expref: 10 pid: 19948 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428080.146250:0:20182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789428080.146253:0:20182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789428080.146256:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208e00/0x84fc867ede5199f2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300ff2 expref: 9 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428080.146322:0:20182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff919581d49600) 00010000:00010000:0.0:1789428080.146326:0:20182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789428080.146330:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685208000/0x84fc867ede519ad2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301031 expref: 8 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428080.146345:0:20182:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9196989f7c00) 00010000:00010000:0.0:1789428080.146352:0:20182:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789428080.146357:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209000/0x84fc867ede519b81 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301070 expref: 7 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428080.146369:0:20182:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9196bca05800, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1789428080.146392:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428080.146394:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428080.146396:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428080.161010:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428080.161127:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931713152 00000100:00100000:2.0:1789428080.161140:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931713152 00000100:00100000:2.0:1789428080.161215:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00100000:2.0:1789428080.161224:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+5:2393:x1876350931713152:12345-192.168.202.24@tcp:39:umount.0 00000020:00000080:2.0:1789428080.161256:0:17161:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51992e 00000100:00080000:2.0:1789428080.161294:0:17161:0:(import.c:65:import_set_state_nolock()) ffff9196bbb8c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789428080.161389:0:17161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1789428080.161648:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e6ed65ac-7f4d-4931-a4b8-22e3b619fb76+3:2393:x1876350931713152:12345-192.168.202.24@tcp:39:umount.0 Request processed in 424us (648us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789428080.161657:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 68 00000100:00080000:0.0:1789428080.162611:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789428080.163811:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428080.368799:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428080.944919:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789428080.944944:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940164992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789428080.945013:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428080.945125:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940164992 00000100:00100000:2.0:1789428080.945134:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940164992 00000100:00100000:2.0:1789428080.945197:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789428080.945209:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940164992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789428080.945238:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789428080.945297:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688823b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940164992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428080.945305:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789428080.945365:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940164992:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789428080.945430:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789428080.947065:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789428080.947081:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940165120:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789428080.947131:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428080.947218:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940165120 00000100:00100000:2.0:1789428080.947226:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940165120 00000100:00100000:2.0:1789428080.947294:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789428080.947303:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940165120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789428080.947321:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789428080.947362:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688820700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940165120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428080.947369:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789428080.947476:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789428080.947506:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940165120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789428081.127875:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428081.128002:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428081.128042:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428081.128074:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428081.128101:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428081.128166:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931713280 00000100:00100000:0.0:1789428081.128178:0:17153:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931713280 00000100:00100000:0.0:1789428081.128231:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 167 00000100:00100000:0.0:1789428081.128240:0:17153:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:2395:x1876350931713280:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789428081.128369:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931713536 00000100:00100000:1.0:1789428081.128374:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931713536 00000100:00100000:1.0:1789428081.128450:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931713408 00000100:00100000:1.0:1789428081.128454:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931713408 00000100:00100000:1.0:1789428081.128486:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00100000:0.0:1789428081.128545:0:17153:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:2395:x1876350931713280:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 305us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428081.128554:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 167 00000100:00100000:2.0:1789428081.128568:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931713664 00000100:00100000:2.0:1789428081.128574:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931713664 00000100:00100000:0.0:1789428081.128608:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 66 00000100:00100000:2.0:1789428081.128613:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931713792 00000100:00100000:2.0:1789428081.128617:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931713792 00000100:00100000:0.0:1789428081.128619:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2395:x1876350931713408:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428081.128646:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:2.0:1789428081.128657:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2393:x1876350931713664:12345-192.168.202.24@tcp:9:kworker.0 00000100:00100000:0.0:1789428081.128659:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2395:x1876350931713408:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 43us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428081.128671:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 66 00000020:00000080:2.0:1789428081.128692:0:18665:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519974 00000100:00100000:0.0:1789428081.128700:0:18820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00080000:2.0:1789428081.128704:0:18665:0:(import.c:65:import_set_state_nolock()) ffff9196b5b35800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789428081.128724:0:18820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2393:x1876350931713792:12345-192.168.202.24@tcp:9:kworker.0 00000020:00000080:0.0:1789428081.128747:0:18820:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51997b 00000001:00000004:2.0:1789428081.128752:0:18665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:0.0:1789428081.128755:0:18820:0:(import.c:65:import_set_state_nolock()) ffff9196bbb83000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789428081.128788:0:18820:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1789428081.128902:0:18820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+2:2393:x1876350931713792:12345-192.168.202.24@tcp:9:kworker.0 Request processed in 176us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428081.128903:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+2:2393:x1876350931713664:12345-192.168.202.24@tcp:9:kworker.0 Request processed in 243us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428081.128919:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:1.0:1789428081.128936:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbb15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2395:x1876350931713536:12345-192.168.202.24@tcp:400:kworker.0 00010000:00010000:2.0:1789428081.128971:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428081.128973:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbb15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2395:x1876350931713536:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 478us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428081.128981:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 65 00000100:00080000:2.0:1789428081.129002:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789428081.129007:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789428081.129011:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789428081.129012:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789428081.129014:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789428081.129145:0:18820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:2.0:1789428081.187094:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428081.187135:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428081.187237:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428081.191663:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931713920 00000100:00100000:3.0:1789428081.191678:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931713920 00000100:00100000:3.0:1789428081.191748:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931714176 00000100:00100000:3.0:1789428081.191751:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931714176 00000100:00100000:3.0:1789428081.191767:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931714048 00000100:00100000:3.0:1789428081.191770:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931714048 00000100:00100000:2.0:1789428081.191822:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428081.191888:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:3.0:1789428081.191900:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+12:2396:x1876350931713920:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789428081.191917:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428081.191936:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428a00/0x84fc867ede519951 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300f74 expref: 12 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428081.191954:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428081.192027:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:1.0:1789428081.192035:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+11:2396:x1876350931714176:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789428081.192044:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428081.192056:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f46400/0x84fc867ede519997 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fe4 expref: 11 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428081.192066:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428081.192512:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+10:2396:x1876350931713920:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 611us (5424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428081.192521:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:3.0:1789428081.192543:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:3.0:1789428081.192553:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+9:2396:x1876350931714048:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789428081.192561:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428081.192584:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f47000/0x84fc867ede519958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300fa5 expref: 9 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428081.192595:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428081.194375:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+8:2396:x1876350931714176:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 2332us (7230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428081.194381:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+8:2396:x1876350931714048:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 1827us (7140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428081.194682:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931714432 00000100:00100000:2.0:1789428081.194692:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931714432 00000100:00100000:1.0:1789428081.194704:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:2.0:1789428081.194744:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 69 00000100:00100000:2.0:1789428081.194755:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+6:2393:x1876350931714432:12345-192.168.202.24@tcp:39:umount.0 00000020:00000080:2.0:1789428081.194795:0:17161:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519966 00000020:00010000:2.0:1789428081.194804:0:17161:0:(genops.c:1920:obd_stale_export_put()) Put export ffff919582400000: total 0 00000100:00080000:2.0:1789428081.194809:0:17161:0:(import.c:65:import_set_state_nolock()) ffff9196b5b32800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789428081.194839:0:17161:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00010000:1.0:1789428081.194848:0:17147:0:(genops.c:1906:obd_stale_export_get()) Get export ffff919582400000: total 0 00010000:00010000:1.0:1789428081.194852:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428081.194912:0:17147:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff919582400000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789428081.194958:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196989f7300) 00010000:00010000:1.0:1789428081.194963:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789428081.194972:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919685209400/0x84fc867ede519a5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730100e expref: 5 pid: 17160 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428081.195005:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+4:2393:x1876350931714432:12345-192.168.202.24@tcp:39:umount.0 Request processed in 250us (3185us total) trans 8589934628 rc 0/0 00000100:00100000:2.0:1789428081.195014:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 69 00010000:00010000:1.0:1789428081.195019:0:17147:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff919582400000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789428081.195034:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428081.195036:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428081.195038:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428081.195698:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:2.0:1789428081.204183:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428081.204240:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931714560 00000100:00100000:1.0:1789428081.204251:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931714560 00000100:00100000:1.0:1789428081.204367:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 70 00000100:00100000:1.0:1789428081.204379:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+5:2393:x1876350931714560:12345-192.168.202.24@tcp:39:umount.0 00000020:00000080:1.0:1789428081.204449:0:19948:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51996d 00000100:00080000:1.0:1789428081.204461:0:19948:0:(import.c:65:import_set_state_nolock()) ffff9196b5b36000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789428081.204504:0:19948:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1789428081.204654:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9c0deec9-ec0d-4fa2-81f3-06fef9176ea3+3:2393:x1876350931714560:12345-192.168.202.24@tcp:39:umount.0 Request processed in 277us (479us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789428081.204662:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 70 00010000:00010000:0.0:1789428081.204789:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428081.235530:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428081.235739:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931714816 00000100:00100000:3.0:1789428081.235751:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931714816 00000100:00100000:3.0:1789428081.235847:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 168 00000100:00100000:3.0:1789428081.235858:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+7:2393:x1876350931714816:12345-192.168.202.24@tcp:251:umount.0 00000020:00000080:3.0:1789428081.235906:0:17151:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519904 00000020:00010000:3.0:1789428081.235914:0:17151:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9196bca06000: total 0 00000100:00080000:3.0:1789428081.235920:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9196bca00000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789428081.236003:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d+3:2393:x1876350931714816:12345-192.168.202.24@tcp:251:umount.0 Request processed in 147us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428081.236011:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 168 00000020:00010000:1.0:1789428081.236068:0:17148:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9196bca06000: total 0 00010000:00010000:1.0:1789428081.236118:0:17148:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9196bca06000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789428081.236161:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208400/0x84fc867ede51990b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7300efd expref: 2 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428081.236180:0:17148:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9196bca06000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1789428081.236192:0:17148:0:(genops.c:885:class_export_put()) final put ffff9196bca06000/4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d 00010000:00010000:1.0:1789428081.236220:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428081.236223:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428081.236225:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789428081.236236:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bca06000/4f0eaa9b-28b1-4ee6-8efa-6c5e64403d8d for MGS 00000020:00000080:1.0:1789428081.236280:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bca00000 for MGS 00010000:00010000:1.0:1789428081.392662:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428081.457170:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940165376:0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.457250:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428081.457308:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940165888:0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.457345:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428081.457371:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940166400:0@lo:400:kworker.0 00000100:00100000:2.0:1789428081.457379:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940165248:0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.457401:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428081.457440:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428081.457456:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789428081.457466:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940165504:0@lo:400:kworker.0 00000100:00100000:2.0:1789428081.457482:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940165760:0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.457491:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428081.457513:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428081.457527:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940166016:0@lo:400:kworker.0 00000100:00100000:2.0:1789428081.457537:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940166272:0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.457565:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428081.457599:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940166528:0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.457715:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428081.457748:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940165376 00000100:00100000:3.0:1789428081.457756:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940165376 00000100:00100000:3.0:1789428081.457798:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940165760 00000100:00100000:3.0:1789428081.457801:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940165760 00000100:00100000:3.0:1789428081.457826:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789428081.457836:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940165376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.457948:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940165376:12345-0@lo:400:kworker.0 Request processed in 113us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428081.457956:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789428081.457980:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789428081.457987:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940165760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.458021:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940165760:12345-0@lo:400:kworker.0 Request processed in 35us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428081.458026:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789428081.458047:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940165888 00000100:00100000:3.0:1789428081.458051:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940165888 00000100:00100000:3.0:1789428081.458085:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940165504 00000100:00100000:3.0:1789428081.458089:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940165504 00000100:00100000:1.0:1789428081.458109:0:18820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789428081.458121:0:18820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940165888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.458125:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789428081.458136:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940165504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428081.458170:0:18820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940165888:12345-0@lo:400:kworker.0 Request processed in 52us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428081.458180:0:18820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789428081.458182:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940165504:12345-0@lo:400:kworker.0 Request processed in 46us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428081.458191:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789428081.458221:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940166400 00000100:00100000:3.0:1789428081.458225:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940166400 00000100:00100000:3.0:1789428081.458257:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940166016 00000100:00100000:3.0:1789428081.458262:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940166016 00000100:00100000:3.0:1789428081.458291:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940166528 00000100:00100000:0.0:1789428081.458291:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940165248 00000100:00100000:3.0:1789428081.458298:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940166528 00000100:00100000:0.0:1789428081.458298:0:17152:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940165248 00000100:00100000:3.0:1789428081.458318:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789428081.458328:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940166400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428081.458337:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789428081.458346:0:17152:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3616:x1876350940165248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.458364:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940166400:12345-0@lo:400:kworker.0 Request processed in 38us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428081.458371:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789428081.458392:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789428081.458394:0:17152:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3616:x1876350940165248:12345-0@lo:400:kworker.0 Request processed in 47us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428081.458404:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940166016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428081.458404:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789428081.458467:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940166016:12345-0@lo:400:kworker.0 Request processed in 67us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428081.458473:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789428081.458489:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789428081.458495:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940166528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.458523:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940166528:12345-0@lo:400:kworker.0 Request processed in 28us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428081.458530:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1789428081.458569:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789428081.458573:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789428081.458577:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789428081.458594:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940165632:0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.458622:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428081.458646:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940166144:0@lo:400:kworker.0 00000100:00100000:1.0:1789428081.458651:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940165632 00000100:00100000:1.0:1789428081.458657:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940165632 00000100:00100000:3.0:1789428081.458685:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428081.458696:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940166144 00000100:00100000:1.0:1789428081.458702:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940166144 00000100:00100000:3.0:1789428081.458708:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940166656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789428081.458730:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428081.458749:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789428081.458755:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940166784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789428081.458774:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428081.458798:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940166656 00000100:00100000:3.0:1789428081.458802:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940166656 00000100:00100000:3.0:1789428081.458819:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940166784 00000100:00100000:3.0:1789428081.458822:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940166784 00000100:00100000:3.0:1789428081.458833:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789428081.458840:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940166656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789428081.458863:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789428081.458895:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789428081.458910:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940166656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428081.458910:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940165632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.458924:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789428081.458939:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789428081.458948:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940166784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789428081.458959:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789428081.458959:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940165632:12345-0@lo:400:kworker.0 Request processed in 55us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428081.458969:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789428081.458991:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940166784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428081.458991:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789428081.459002:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789428081.459005:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940166144:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789428081.459027:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789428081.459040:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428081.459046:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940166144:12345-0@lo:400:kworker.0 Request processed in 44us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428081.459053:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789428081.459068:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940166272 00000100:00100000:1.0:1789428081.459072:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940166272 00000100:00100000:3.0:1789428081.459082:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940165248:0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.459100:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940165760:0@lo:400:kworker.0 00000100:00100000:1.0:1789428081.459105:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789428081.459117:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940166272:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789428081.459141:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789428081.459166:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940166784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789428081.459316:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940165632:0@lo:400:kworker.0 00000100:00100000:1.0:1789428081.459318:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1876350940166272:12345-0@lo:400:kworker.0 Request processed in 202us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428081.459329:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789428081.459333:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940166144:0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.459354:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940166656:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789428081.459391:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bbbcb800 x1876350940166272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428081.459402:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3616:1876350940166272:0@lo:400:kworker.0 00000100:00100000:2.0:1789428081.459504:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940165376:0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.459593:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940165888:0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.459605:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940166400:0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.459622:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940165504:0@lo:400:kworker.0 00000100:00100000:3.0:1789428081.459633:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940166016:0@lo:400:kworker.0 00010000:00080000:3.0:1789428081.459644:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bbbc9880 x1876350940166528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428081.459653:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940166528:0@lo:400:kworker.0 00010000:00010000:0.0:1789428082.416973:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428082.480665:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940166912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789428082.480744:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428082.481299:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940166912 00000100:00100000:2.0:1789428082.481308:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940166912 00000100:00100000:2.0:1789428082.481365:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789428082.481375:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940166912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789428082.481441:0:17164:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1789428082.481675:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940166912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 300us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428082.481684:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789428082.481746:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940166912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789428082.483884:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789428082.483903:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688822300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940167040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789428082.483983:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428082.484026:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940167040 00000100:00100000:0.0:1789428082.484034:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940167040 00000100:00100000:0.0:1789428082.484083:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789428082.484093:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940167040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789428082.484124:0:17165:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789428082.485494:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688823800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940167040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1395us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428082.485508:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000001:00100000:2.0:1789428082.486864:0:17139:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 00000001:00080000:2.0:1789428082.486879:0:17139:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1789428082.486896:0:17139:0:(genops.c:885:class_export_put()) final put ffff919582400000/9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 00000001:00100000:2.0:1789428082.486915:0:17139:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 00000001:00080000:2.0:1789428082.486920:0:17139:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1789428082.486926:0:17139:0:(genops.c:885:class_export_put()) final put ffff9196bca05800/e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 00000020:00080000:2.0:1789428082.486933:0:17139:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00000080:0.0:1789428082.486944:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919582400000/9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 for lustre-MDT0000 00000020:00080000:2.0:1789428082.486951:0:17198:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1789428082.486960:0:17198:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00000080:0.0:1789428082.487012:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bca05800/e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 for lustre-MDT0000 00000020:00000080:0.0:1789428082.487057:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196b5b32800 for lustre-MDT0000 00000020:00000080:0.0:1789428082.487062:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bca05000 for lustre-MDT0000 00000100:00100000:1.0:1789428082.487588:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688822300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940167040:0@lo:41:osp-pre-1-0.0 00000020:01000004:3.0:1789428082.567930:0:20727:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789428082.588587:0:20727:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789428082.588643:0:20727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.588660:0:20727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.588667:0:20727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.588745:0:20727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.588767:0:20727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789428082.588772:0:20727:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789428082.588798:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789428082.588803:0:20727:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789428082.588809:0:20727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789428082.588836:0:20727:0:(import.c:65:import_set_state_nolock()) ffff919690577800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789428082.589024:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350940167168:0@lo:39:umount.0 00000100:00100000:2.0:1789428082.589093:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428082.589275:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940167168 00000100:00100000:3.0:1789428082.589284:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940167168 00000100:00100000:3.0:1789428082.589328:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789428082.589336:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3612:x1876350940167168:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789428082.589361:0:19948:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5194f8 00000100:00080000:3.0:1789428082.589369:0:19948:0:(import.c:65:import_set_state_nolock()) ffff919582431000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789428082.589442:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3612:x1876350940167168:12345-0@lo:39:umount.0 Request processed in 106us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428082.589464:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:3.0:1789428082.589473:0:19948:0:(genops.c:885:class_export_put()) final put ffff919582432800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1789428082.591929:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428082.591943:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.591955:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1789428082.591959:0:17147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.591981:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789428082.591989:0:17147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428082.591995:0:17147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789428082.591997:0:17147:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789428082.592000:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789428082.592794:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.592804:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789428082.592826:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.592834:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ec800/0x84fc867ede5194c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5194ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.592848:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428082.592863:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428082.592865:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428082.592872:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428082.592889:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940167296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428082.592945:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428082.594304:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940167296 00000100:00100000:1.0:1789428082.594316:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940167296 00000100:00100000:1.0:1789428082.594373:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428082.594384:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3615:x1876350940167296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428082.594398:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428082.594437:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f47e00/0x84fc867ede5194ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5194c7 expref: 24 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428082.594453:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428082.594509:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:3615:x1876350940167296:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428082.594516:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789428082.594612:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6c098993-d5b4-48be-b0c2-bdb904c28b81:3615:1876350940167296:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1789428082.598213:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff919582432800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1789428082.598300:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919690577800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1789428082.598306:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919582431000 for lustre-MDT0000 00000100:00100000:3.0:1789428082.598329:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350940167168:0@lo:39:umount.0 00000100:00080000:2.0:1789428082.598348:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789428082.598353:0:20727:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789428082.598358:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789428082.599886:0:20727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.599902:0:20727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.599909:0:20727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.599916:0:20727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.599941:0:20727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428082.599961:0:20727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.599967:0:20727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.600364:0:20727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.600372:0:20727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.600389:0:20727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789428082.600396:0:20727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.600403:0:20727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.600410:0:20727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.600437:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789428082.600450:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.600450:0:20727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.600473:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1789428082.600478:0:17147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.600480:0:20727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789428082.600489:0:20727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.600492:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.600503:0:20727:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789428082.600506:0:17147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428082.600523:0:17147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789428082.600527:0:17147:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789428082.600527:0:20727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.600537:0:20727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428082.600547:0:20727:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1789428082.600551:0:20727:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789428082.600554:0:20727:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1789428082.600563:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.600570:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:01000004:2.0:1789428082.600585:0:20727:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789428082.600590:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:3.0:1789428082.600594:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789428082.600595:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789428082.600600:0:20727:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1789428082.600610:0:20727:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff919582406000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1789428082.600611:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583f46600/0x84fc867ede519418 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51941f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789428082.600620:0:20727:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff919582431800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789428082.600627:0:20727:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff91968382c000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1789428082.600632:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00080000:2.0:1789428082.600633:0:20727:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff919583d50800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:3.0:1789428082.600639:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789428082.600641:0:20727:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9196bf98cd40) has exports, disconnecting them 00000020:00080000:2.0:1789428082.600648:0:20727:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff919582406000), last request at 1789428081 00010000:00010000:3.0:1789428082.600651:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813eca00 already unused, calling callback (ffffffffc118ec20) 00000020:00000080:2.0:1789428082.600656:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5197fa 10000000:00010000:3.0:1789428082.600657:0:17147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.600667:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789428082.600674:0:17147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789428082.600676:0:20727:0:(import.c:65:import_set_state_nolock()) ffff919582403800 : changing import state from FULL to CLOSED 10000000:01000000:3.0:1789428082.600684:0:17147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789428082.600687:0:17147:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789428082.600689:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789428082.600707:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.600712:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:2.0:1789428082.600720:0:20727:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff919582406000): rc 0 00000020:00000080:2.0:1789428082.600723:0:20727:0:(genops.c:885:class_export_put()) final put ffff919582406000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789428082.600734:0:20727:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff919582431800), last request at 1789428081 00010000:00010000:3.0:1789428082.600735:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789428082.600738:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51969c 00010000:00010000:3.0:1789428082.600746:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813eca00/0x84fc867ede519824 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51982b expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789428082.600747:0:20727:0:(import.c:65:import_set_state_nolock()) ffff919582435000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789428082.600763:0:20727:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff919582431800): rc 0 00000020:00000080:2.0:1789428082.600767:0:20727:0:(genops.c:885:class_export_put()) final put ffff919582431800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789428082.600772:0:20727:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91968382c000), last request at 1789428025 00010000:00010000:3.0:1789428082.600773:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00000080:2.0:1789428082.600778:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5195e6 00010000:00010000:3.0:1789428082.600779:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789428082.600784:0:20727:0:(import.c:65:import_set_state_nolock()) ffff91968382e000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789428082.600791:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375d600 already unused, calling callback (ffffffffc118ec20) 00000020:00080000:2.0:1789428082.600793:0:20727:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff91968382c000): rc 0 10000000:00010000:3.0:1789428082.600795:0:17147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789428082.600797:0:20727:0:(genops.c:885:class_export_put()) final put ffff91968382c000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789428082.600804:0:20727:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff919583d50800), last request at 1789428025 00010000:00010000:3.0:1789428082.600810:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789428082.600810:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519584 00000100:00080000:2.0:1789428082.600816:0:20727:0:(import.c:65:import_set_state_nolock()) ffff919583d57800 : changing import state from FULL to CLOSED 10000000:00010000:3.0:1789428082.600822:0:17147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1789428082.600825:0:20727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 10000000:01000000:3.0:1789428082.600830:0:17147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789428082.600833:0:17147:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789428082.600835:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789428082.600850:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.600856:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789428082.600863:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.600869:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff91958375d600/0x84fc867ede5199cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5199d6 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.600879:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428082.600882:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.600895:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46c00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1789428082.600898:0:17147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.600906:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789428082.600910:0:20727:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff919583d50800): rc 0 10000000:00010000:3.0:1789428082.600915:0:17147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:2.0:1789428082.600919:0:20727:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb489c7af3ae0 10000000:01000000:3.0:1789428082.600923:0:17147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789428082.600928:0:17147:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789428082.600929:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:2.0:1789428082.600940:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00010000:00010000:3.0:1789428082.600944:0:17147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428082.600945:0:20727:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1789428082.600954:0:17147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789428082.600961:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.600967:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583f46c00/0x84fc867ede51940a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede519411 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.600976:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428082.600978:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428082.600979:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428082.600995:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940167552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428082.601057:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789428082.601068:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428082.601100:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789428082.601114:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940167680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428082.601139:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789428082.601238:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919582406000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1789428082.601240:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940167424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428082.601282:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789428082.601290:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919582431800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789428082.601315:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff91968382c000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789428082.601340:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919582403800 for lustre-MDT0000 00000020:00000080:0.0:1789428082.601346:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919582435000 for lustre-MDT0000 00000020:00000080:0.0:1789428082.601348:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff91968382e000 for lustre-MDT0000 00000100:00100000:3.0:1789428082.601520:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789428082.601526:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940167808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428082.601549:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428082.601568:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940167552 00000100:00100000:1.0:1789428082.601577:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940167552 00000100:00100000:1.0:1789428082.601624:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940167680 00000100:00100000:1.0:1789428082.601627:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940167680 00000100:00100000:1.0:1789428082.601640:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940167424 00000100:00100000:1.0:1789428082.601642:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940167424 00000100:00100000:1.0:1789428082.601656:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428082.601665:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+25:3613:x1876350940167552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428082.601678:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428082.601692:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91958375ce00/0x84fc867ede51982b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede519824 expref: 25 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428082.601705:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428082.601743:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+24:3613:x1876350940167552:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428082.601760:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428082.601780:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789428082.601786:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bce68450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+23:3613:x1876350940167680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428082.601793:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428082.601803:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685209c00/0x84fc867ede5199d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5199cf expref: 23 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428082.601811:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428082.601834:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bce68450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+22:3613:x1876350940167680:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428082.601840:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789428082.601880:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789428082.601887:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+21:3616:x1876350940167424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428082.601894:0:17144:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428082.601902:0:17144:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1e600/0x84fc867ede51941f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede519418 expref: 21 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428082.601910:0:17144:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428082.601930:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:3616:x1876350940167424:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428082.601935:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789428082.602037:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940167424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428082.602066:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940167680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428082.602074:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940167552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428082.602091:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940167808 00000100:00100000:3.0:1789428082.602095:0:17145:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940167808 00000100:00100000:3.0:1789428082.602121:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789428082.602127:0:17145:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+20:3616:x1876350940167808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428082.602135:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428082.602144:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91958375ca00/0x84fc867ede519411 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede51940a expref: 20 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428082.602153:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1789428082.602176:0:20727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789428082.602193:0:20727:0:(import.c:65:import_set_state_nolock()) ffff9196905eb000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789428082.602327:0:17145:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:3616:x1876350940167808:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428082.602335:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789428082.602357:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940167936:0@lo:39:umount.0 00000100:00100000:3.0:1789428082.602387:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428082.602485:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940167936 00000100:00100000:3.0:1789428082.602495:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940167936 00000100:00100000:3.0:1789428082.602524:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789428082.602530:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3612:x1876350940167936:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789428082.602554:0:17164:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519610 00000100:00080000:3.0:1789428082.602561:0:17164:0:(import.c:65:import_set_state_nolock()) ffff9196ade16000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789428082.602579:0:17164:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789428082.602685:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3612:x1876350940167936:12345-0@lo:39:umount.0 Request processed in 155us (297us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789428082.602692:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789428082.602721:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196905eb000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789428082.602728:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940167936:0@lo:39:umount.0 00000100:00100000:3.0:1789428082.602744:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940167808:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428082.602758:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789428082.603092:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789428082.603095:0:20727:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1789428082.603139:0:20727:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789428082.603256:0:20727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789428082.603278:0:20727:0:(import.c:65:import_set_state_nolock()) ffff9196ad917000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789428082.603292:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789428082.603295:0:20727:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:3.0:1789428082.603306:0:20727:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789428082.603383:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940168064:0@lo:9:umount.0 00000100:00100000:3.0:1789428082.603439:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789428082.603475:0:20727:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789428082.603486:0:20727:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789428082.603504:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940168192:0@lo:9:umount.0 00000100:00100000:3.0:1789428082.603553:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428082.603584:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940168064 00000100:00100000:3.0:1789428082.603589:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940168064 00000100:00100000:3.0:1789428082.603626:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940168192 00000100:00100000:3.0:1789428082.603629:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940168192 00000100:00100000:3.0:1789428082.603653:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789428082.603660:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3612:x1876350940168064:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789428082.603679:0:18665:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5196d4 00000100:00080000:3.0:1789428082.603686:0:18665:0:(import.c:65:import_set_state_nolock()) ffff9196adde2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789428082.603720:0:18665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789428082.603815:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3612:x1876350940168064:12345-0@lo:9:umount.0 Request processed in 156us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428082.603822:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789428082.603836:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789428082.603842:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3612:x1876350940168192:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789428082.603853:0:18665:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519832 00000100:00080000:3.0:1789428082.603859:0:18665:0:(import.c:65:import_set_state_nolock()) ffff919583357800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789428082.603880:0:18665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1789428082.603944:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3612:x1876350940168192:12345-0@lo:9:umount.0 Request processed in 102us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428082.603951:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1789428082.603966:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789428082.603978:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789428082.603997:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196867e4800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789428082.604005:0:3612:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789428082.604006:0:3612:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789428082.604010:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940168192:0@lo:9:umount.0 00000100:00080000:3.0:1789428082.604019:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196ad917000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00080000:2.0:1789428082.604123:0:20727:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9196bf98cd40) has no exports 00010000:00010000:1.0:1789428082.604207:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789428082.604377:0:3612:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789428082.604380:0:3612:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789428082.604384:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940168064:0@lo:9:umount.0 00010000:00010000:1.0:1789428082.605476:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789428082.625735:0:20727:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9196bf98cd40) has no exports 00000020:00000080:3.0:1789428082.727351:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519465 00000020:00000080:3.0:1789428082.727367:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196867e4000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789428082.727390:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789428082.727440:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196867e4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789428082.735810:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789428082.735828:0:20727:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789428082.735834:0:20727:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff919583028000) has no exports 00000020:00000080:2.0:1789428082.739340:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51945e 00000020:00000080:2.0:1789428082.739353:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196905ee800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789428082.739471:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789428082.739482:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789428082.739485:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196905e9800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789428082.739487:0:20727:0:(genops.c:844:class_export_destroy()) destroying export ffff9196905e9800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789428082.739496:0:20727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1789428082.739737:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196905ee800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789428083.442821:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428084.464755:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428085.488682:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789428085.555515:0:19476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789428085.555585:0:19476:0:(genops.c:885:class_export_put()) final put ffff919583351800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789428085.555608:0:19476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 00000020:00000080:2.0:1789428085.555611:0:19476:0:(genops.c:885:class_export_put()) final put ffff9196bbb87000/9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 00000001:00100000:2.0:1789428085.555621:0:19476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 00000020:00000080:2.0:1789428085.555623:0:19476:0:(genops.c:885:class_export_put()) final put ffff9196bca03000/e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 00000020:00000080:2.0:1789428085.555645:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff919583351800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789428085.555745:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bbb87000/9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 for lustre-OST0001 00000020:00000080:2.0:1789428085.555771:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bca03000/e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 for lustre-OST0001 00000020:00000080:2.0:1789428085.556343:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583357800 for lustre-OST0001 00000020:00000080:2.0:1789428085.556350:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bbb83000 for lustre-OST0001 00000020:00000080:2.0:1789428085.556353:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bca07000 for lustre-OST0001 00000001:00100000:2.0:1789428085.556380:0:17891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789428085.556386:0:17891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:2.0:1789428085.556389:0:17891:0:(genops.c:885:class_export_put()) final put ffff9196b5aa8800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789428085.556603:0:17891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 00000001:00080000:2.0:1789428085.556609:0:17891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:2.0:1789428085.556610:0:17891:0:(genops.c:885:class_export_put()) final put ffff9196b5b34800/9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 00000001:00100000:2.0:1789428085.556614:0:17891:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 00000001:00080000:2.0:1789428085.556618:0:17891:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:2.0:1789428085.556619:0:17891:0:(genops.c:885:class_export_put()) final put ffff919582434000/e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 00000020:00000080:3.0:1789428085.556728:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b5aa8800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789428085.556781:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b5b34800/9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 for lustre-MDT0001 00000020:00000080:3.0:1789428085.556819:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919582434000/e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 for lustre-MDT0001 00000020:00000080:3.0:1789428085.556849:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196ade16000 for lustre-MDT0001 00000020:00000080:3.0:1789428085.556855:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196b5b36000 for lustre-MDT0001 00000020:00000080:3.0:1789428085.556860:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bbb8c000 for lustre-MDT0001 00000001:00100000:1.0:1789428085.558449:0:18659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789428085.558464:0:18659:0:(genops.c:885:class_export_put()) final put ffff9196adde6800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789428085.558488:0:18659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 00000020:00000080:1.0:1789428085.558490:0:18659:0:(genops.c:885:class_export_put()) final put ffff9196b5b30000/9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 00000001:00100000:1.0:1789428085.558497:0:18659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 00000020:00000080:1.0:1789428085.558499:0:18659:0:(genops.c:885:class_export_put()) final put ffff9196bca04000/e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 00000020:00000080:3.0:1789428085.558558:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196adde6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789428085.558598:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b5b30000/9c0deec9-ec0d-4fa2-81f3-06fef9176ea3 for lustre-OST0000 00000020:00000080:3.0:1789428085.558617:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bca04000/e6ed65ac-7f4d-4931-a4b8-22e3b619fb76 for lustre-OST0000 00000020:00000080:3.0:1789428085.558639:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196adde2000 for lustre-OST0000 00000020:00000080:3.0:1789428085.558645:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196b5b35800 for lustre-OST0000 00000020:00000080:3.0:1789428085.558650:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bca01800 for lustre-OST0000 00000100:00100000:3.0:1789428086.064800:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940168320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789428086.064879:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428086.065058:0:18667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940168320 00000100:00100000:2.0:1789428086.065067:0:18667:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940168320 00000100:00080000:3.0:1789428086.065143:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789428086.065149:0:18667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789428086.065162:0:18667:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940168320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789428086.065192:0:18667:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789428086.065258:0:18667:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940168320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428086.065283:0:18667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789428086.065344:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940168320:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789428086.512532:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428086.576881:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940168448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789428086.577057:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428086.577244:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940168704:0@lo:400:kworker.0 00000100:00100000:0.0:1789428086.577280:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428086.577302:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940169216:0@lo:400:kworker.0 00000100:00100000:0.0:1789428086.577324:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428086.577343:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789428086.577349:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940168832:0@lo:400:kworker.0 00000100:00100000:0.0:1789428086.577374:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428086.577391:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688822300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940169344:0@lo:400:kworker.0 00000100:00100000:0.0:1789428086.577406:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428086.577482:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c098993-d5b4-48be-b0c2-bdb904c28b81:3614:1876350940168576:0@lo:400:kworker.0 00000100:00100000:0.0:1789428086.577503:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940168704 00000100:00100000:0.0:1789428086.577511:0:17165:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940168704 00000100:00100000:3.0:1789428086.577524:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428086.577562:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940169088:0@lo:400:kworker.0 00000100:00100000:0.0:1789428086.577568:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789428086.577578:0:17165:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1876350940168704:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789428086.577587:0:17165:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789428086.577592:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428086.577615:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789428086.577623:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940168960:0@lo:400:kworker.0 00000100:00100000:0.0:1789428086.577640:0:17165:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3615:x1876350940168704:12345-0@lo:400:kworker.0 Request processed in 61us (358us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789428086.577648:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789428086.577653:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428086.577682:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940169216 00000100:00100000:0.0:1789428086.577686:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940169216 00000100:00100000:0.0:1789428086.577722:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940169344 00000100:00100000:0.0:1789428086.577725:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940169344 00000100:00100000:0.0:1789428086.577736:0:17161:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940169088 00000100:00100000:0.0:1789428086.577739:0:17161:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940169088 00000100:00100000:0.0:1789428086.577749:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789428086.577755:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940169216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428086.577794:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940169216:12345-0@lo:400:kworker.0 Request processed in 39us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428086.577800:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789428086.577812:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789428086.577816:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1876350940169344:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789428086.577820:0:17161:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789428086.577840:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1876350940169344:12345-0@lo:400:kworker.0 Request processed in 23us (433us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789428086.577845:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789428086.577854:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789428086.577857:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876350940169088:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789428086.577860:0:17161:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789428086.577876:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3614:x1876350940169088:12345-0@lo:400:kworker.0 Request processed in 18us (288us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789428086.577880:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789428086.577893:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940168832 00000100:00100000:0.0:1789428086.577896:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940168832 00000100:00100000:0.0:1789428086.577925:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789428086.577931:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940169472:0@lo:400:kworker.0 00000100:00100000:0.0:1789428086.577935:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195831bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940168832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428086.578010:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940168960 00000100:00100000:1.0:1789428086.578014:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940168960 00000100:00100000:1.0:1789428086.578030:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789428086.578035:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3614:x1876350940168960:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789428086.578040:0:17160:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789428086.578202:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940168576 00000100:00100000:2.0:1789428086.578207:0:17151:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940168576 00000100:00100000:2.0:1789428086.578249:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789428086.578256:0:17151:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583da0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:3614:x1876350940168576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428086.578431:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195831bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940168832:12345-0@lo:400:kworker.0 Request processed in 481us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428086.578445:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789428086.578473:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789428086.578518:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688822a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940168832:0@lo:400:kworker.0 00000100:00080000:0.0:1789428086.578528:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789428086.578532:0:3615:0:(import.c:65:import_set_state_nolock()) ffff919583355000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789428086.578536:0:3615:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1789428086.581603:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3614:x1876350940168960:12345-0@lo:400:kworker.0 Request processed in 3557us (3941us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789428086.581619:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789428086.581672:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940168448 00000100:00100000:1.0:1789428086.581681:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940168448 00000100:00100000:1.0:1789428086.581752:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789428086.581760:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940168448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789428086.581789:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789428086.581835:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940168448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (4779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428086.581841:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789428086.581858:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789428086.581871:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428086.581902:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940168448:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789428086.581922:0:3614:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789428086.581929:0:3614:0:(import.c:65:import_set_state_nolock()) ffff919582405000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789428086.581933:0:3614:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789428086.581939:0:3614:0:(import.c:65:import_set_state_nolock()) ffff919582405000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789428086.581943:0:3614:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 382 00000100:00080000:3.0:1789428086.581953:0:3614:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff919582405000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428086.581963:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940169472 00000100:00100000:1.0:1789428086.581967:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940169472 00000100:00100000:1.0:1789428086.581995:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789428086.582001:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940169472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428086.582052:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1876350940169472:12345-0@lo:400:kworker.0 Request processed in 51us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428086.582058:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1789428086.582077:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789428086.582631:0:17151:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583da0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c098993-d5b4-48be-b0c2-bdb904c28b81+19:3614:x1876350940168576:12345-0@lo:400:kworker.0 Request processed in 4373us (5105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428086.582643:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789428086.582857:0:3614:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfa81180 x1876350940169600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789428086.582884:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940169088:0@lo:400:kworker.0 00000100:00080000:3.0:1789428086.582924:0:3614:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789428086.582928:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9196b5aa9800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:00100000:2.0:1789428086.582930:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940169600:0@lo:38:ptlrpcd_00_01.0 00000100:02000400:3.0:1789428086.582933:0:3614:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789428086.582940:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9196b5aa9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789428086.582953:0:3614:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 370 00000100:00100000:2.0:1789428086.582974:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789428086.582980:0:3614:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9196b5aa9800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428086.582998:0:3614:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfa80e00 x1876350940169728/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789428086.583014:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688821c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940168960:0@lo:400:kworker.0 00000100:00100000:2.0:1789428086.583021:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940169728:0@lo:38:ptlrpcd_00_01.0 00010000:00080000:3.0:1789428086.583034:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919688820e00 x1876350940169472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428086.583045:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3614:1876350940169472:0@lo:400:kworker.0 00000100:00100000:2.0:1789428086.583052:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428086.583059:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688821500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6c098993-d5b4-48be-b0c2-bdb904c28b81:3614:1876350940168576:0@lo:400:kworker.0 00000100:00100000:2.0:1789428086.583092:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940169600 00000100:00100000:2.0:1789428086.583098:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940169600 00000100:00100000:2.0:1789428086.583327:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940169728 00000100:00100000:2.0:1789428086.583331:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940169728 00000100:00100000:3.0:1789428086.583395:0:17161:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789428086.583402:0:17161:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1876350940169600:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1789428086.583435:0:17161:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789428086.583486:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789428086.583491:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3612:x1876350940169728:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1789428086.583498:0:19948:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789428086.583533:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3612:x1876350940169728:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 41us (484us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789428086.583539:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1789428086.583576:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b5aa9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789428086.583580:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789428086.583583:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940169728:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1789428086.591577:0:3615:0:(import.c:65:import_set_state_nolock()) ffff919583355000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428086.591588:0:3615:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 395 00000100:00080000:0.0:1789428086.591677:0:3615:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff919583355000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428086.591719:0:3615:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bf480 x1876350940169856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789428086.591825:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940169856:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789428086.591922:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428086.591998:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688822300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940169344:0@lo:400:kworker.0 00000100:00100000:1.0:1789428086.592027:0:19948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940169856 00000100:00100000:1.0:1789428086.592036:0:19948:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940169856 00000100:00080000:0.0:1789428086.592040:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789428086.592045:0:3615:0:(import.c:65:import_set_state_nolock()) ffff919583ec9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789428086.592048:0:3615:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789428086.592053:0:3615:0:(import.c:65:import_set_state_nolock()) ffff919583ec9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428086.592058:0:3615:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 370 00000100:00080000:0.0:1789428086.592065:0:3615:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff919583ec9000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428086.592082:0:19948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789428086.592085:0:3615:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfb8ed80 x1876350940169984/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789428086.592096:0:19948:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3612:x1876350940169856:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1789428086.592122:0:19948:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789428086.592310:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940169984:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1789428086.592342:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428086.592535:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940168704:0@lo:400:kworker.0 00010000:00080000:0.0:1789428086.592556:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919688822680 x1876350940169216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428086.592576:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940169216:0@lo:400:kworker.0 00000100:00100000:0.0:1789428086.592657:0:17899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940169984 00000100:00100000:0.0:1789428086.592663:0:17899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940169984 00000100:00100000:0.0:1789428086.592686:0:17899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789428086.592691:0:17899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3612:x1876350940169984:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1789428086.592700:0:17899:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789428086.592734:0:17899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3612:x1876350940169984:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 41us (390us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789428086.592741:0:17899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789428086.593866:0:19948:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583cbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3612:x1876350940169856:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 1770us (1939us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789428086.593878:0:19948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1789428086.593928:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919583355000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789428086.593935:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789428086.593939:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940169856:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1789428086.593964:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919583ec9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789428086.593968:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789428086.593971:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940169984:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789428086.606214:0:17161:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1876350940169600:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 22804us (23233us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789428086.606241:0:17161:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789428086.606915:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919582405000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789428086.606923:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789428086.606927:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940169600:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1789428087.536804:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789428088.496914:0:17912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789428088.560622:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789428088.626470:0:17139:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789428088.626479:0:17139:0:(genops.c:885:class_export_put()) final put ffff919583d50800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789428088.626559:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff919583d50800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1789428088.626614:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583d57800 for lustre-MDT0000 00000020:01000000:2.0:1789428088.816602:0:20727:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9195810e2ea0 - data ffff91958209b510/ffff9196bbbb7c00 00000020:01000000:2.0:1789428088.816770:0:20727:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9195810b9d80 - data ffff9196bfc2a360/ffff9196b67d2000 00000001:00000004:2.0:1789428088.822761:0:20727:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1789428088.859376:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789428088.859384:0:20727:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789428088.859397:0:20727:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9196bfaa9f80 x1876350940167936/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789428092 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428088.859437:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789428088.860759:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789428088.860764:0:20727:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1789428088.861020:0:20727:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789428088.861023:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789428088.861362:0:17183:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789428088.861368:0:17183:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1789428088.861377:0:17183:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1789428088.862101:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789428088.862105:0:20727:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1789428088.862477:0:20727:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789428088.862480:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789428088.862801:0:17185:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789428088.862805:0:17185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1789428088.862821:0:17185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1789428088.864232:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51942d 00000020:00000080:3.0:1789428088.864245:0:20727:0:(genops.c:885:class_export_put()) final put ffff919690572800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789428088.865511:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519442 00000020:00000080:3.0:1789428088.865521:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196bcc8e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789428088.865527:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789428088.865532:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789428088.865540:0:20727:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789428088.865544:0:20727:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9196bf9899c0) has no exports 00000004:01000000:3.0:1789428088.865692:0:20727:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789428088.865700:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5194a4 00000020:00000080:3.0:1789428088.865704:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196905ad000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789428088.865708:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789428088.865712:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789428088.865716:0:20727:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789428088.865719:0:20727:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff919581dd8000) has no exports 00000020:00000080:3.0:1789428088.865724:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51949d 00000020:00000080:3.0:1789428088.865727:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196867e6000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789428088.866266:0:20727:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789428088.866271:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789428088.866275:0:20727:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:3.0:1789428088.866281:0:20727:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789428088.866283:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789428088.866312:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789428088.866318:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789428088.866323:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51948f 00000020:00000080:3.0:1789428088.866328:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196ad915000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789428088.866332:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789428088.866343:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789428088.866347:0:20727:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789428088.866349:0:20727:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff919581ddb380) has no exports 00000020:00000080:3.0:1789428088.866353:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519488 00000020:00000080:3.0:1789428088.866357:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196ad915800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789428088.866748:0:20727:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789428088.866752:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789428088.866754:0:20727:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 5 00000004:00080000:3.0:1789428088.866758:0:20727:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789428088.866759:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789428088.866778:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789428088.866783:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1789428088.866791:0:20727:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789428088.866796:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51947a 00000020:00000080:3.0:1789428088.866800:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196ad914800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789428088.866803:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1789428088.866806:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789428088.866810:0:20727:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789428088.866812:0:20727:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff91958302cd40) has no exports 00000020:00000080:0.0:1789428088.866918:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919690572800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789428088.866926:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bcc8e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789428088.866931:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196905ad000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789428088.866935:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196867e6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789428088.866940:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196867e4800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789428088.866945:0:8:0:(genops.c:885:class_export_put()) final put ffff9196ad913800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789428088.866947:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad913800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789428088.866950:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789428088.867022:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad915000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789428088.867025:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad915800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789428088.867028:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196ad917000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789428088.867035:0:8:0:(genops.c:885:class_export_put()) final put ffff9196ad916000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789428088.867037:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad916000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789428088.867039:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789428088.867056:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad914800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789428088.867092:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519473 00000020:00000080:3.0:1789428088.867094:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196905ea800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789428088.868093:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196905ea800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789428088.868486:0:20727:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789428088.868490:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789428088.868493:0:20727:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789428088.868497:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789428088.868531:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789428088.868537:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789428088.868565:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789428088.868567:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789428088.868570:0:20727:0:(genops.c:885:class_export_put()) final put ffff919690570000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789428088.868572:0:20727:0:(genops.c:844:class_export_destroy()) destroying export ffff919690570000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789428088.868575:0:20727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789428088.868635:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519449 00000020:00000080:0.0:1789428088.868638:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196bcc8a000/lustre-MDD0000_UUID 00000020:01000000:0.0:1789428088.868641:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789428088.868643:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789428088.868645:0:20727:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789428088.868647:0:20727:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9196bf988000) has no exports 00000020:00000080:0.0:1789428088.868659:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789428088.868661:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789428088.868663:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519450 00000020:00000080:0.0:1789428088.868665:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196bcc8c000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789428088.868670:0:20727:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196bfad4800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789428088.868673:0:20727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bfad4800 3 00000020:01000004:0.0:1789428088.868675:0:20727:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9196bfad4800 from lustre-MDT0000 00000020:00000080:0.0:1789428088.868686:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789428088.868693:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789428088.868695:0:20727:0:(genops.c:885:class_export_put()) final put ffff919690574800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789428088.868697:0:20727:0:(genops.c:844:class_export_destroy()) destroying export ffff919690574800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789428088.868702:0:20727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789428088.868721:0:20727:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789428088.868724:0:20727:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789428088.868726:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789428088.868728:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789428088.868730:0:20727:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789428088.868737:0:20727:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9196bfad6800 6c098993-d5b4-48be-b0c2-bdb904c28b81 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789428088.868742:0:20727:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff919581dd99c0) has exports, disconnecting them 00000020:00080000:0.0:1789428088.868746:0:20727:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9196bfad6800), last request at 1789428013 00000020:00000080:0.0:1789428088.868760:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5193f5 00000020:00010000:0.0:1789428088.868764:0:20727:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9196bfad6800: total 2 00000100:00080000:0.0:1789428088.868768:0:20727:0:(import.c:65:import_set_state_nolock()) ffff9196bfad1800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789428088.868780:0:20727:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9196bfad6800): rc 0 00000020:00080000:0.0:1789428088.868784:0:20727:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff919581dd99c0) has no exports 00000020:00000080:1.0:1789428088.868893:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196905eb000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789428088.868901:0:8:0:(genops.c:885:class_export_put()) final put ffff9196867e2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789428088.868903:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196867e2000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1789428088.868907:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789428088.868955:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bcc8a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789428088.868959:0:8:0:(genops.c:885:class_export_put()) final put ffff919690574000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789428088.868961:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919690574000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789428088.868965:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789428088.868987:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bcc8c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1789428088.869031:0:17152:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9196bcbe5e00:17152] 1 exiting: rc = 0 00000100:00100000:1.0:1789428088.869136:0:17151:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9196bcbe5c00:17151] 0 exiting: rc = 1 00000100:00100000:1.0:1789428088.869291:0:17153:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9195826b6a00:17153] 2 exiting: rc = 0 00000020:00010000:1.0:1789428088.869350:0:17147:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9196bfad6800: total 0 00010000:00010000:1.0:1789428088.869373:0:17147:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9196bfad6800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789428088.869401:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f47800/0x84fc867ede519522 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede51951b expref: 14 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428088.869444:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1f200/0x84fc867ede519514 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede51950d expref: 13 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428088.869457:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f47400/0x84fc867ede5199ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5199b3 expref: 12 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428088.869469:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f46200/0x84fc867ede519530 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede519529 expref: 11 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428088.869478:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813ecc00/0x84fc867ede5197de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5197d7 expref: 10 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428088.869488:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813ec000/0x84fc867ede519403 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5193fc expref: 9 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428088.869496:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208800/0x84fc867ede51981d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede519816 expref: 8 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428088.869507:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196813ede00/0x84fc867ede519680 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede519679 expref: 7 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428088.869516:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685209600/0x84fc867ede5199ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5199a5 expref: 6 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428088.869525:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f46000/0x84fc867ede5195d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5195ca expref: 5 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428088.869546:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208c00/0x84fc867ede5199c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5199c1 expref: 4 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428088.869556:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91958375d200/0x84fc867ede5197b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede5197ad expref: 3 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428088.869565:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91958375c000/0x84fc867ede519656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x84fc867ede51964f expref: 2 pid: 17153 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428088.869575:0:17147:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9196bfad6800, canceled 13 locks, left on hash table 0. 00000020:00000080:1.0:1789428088.869587:0:17147:0:(genops.c:885:class_export_put()) final put ffff9196bfad6800/6c098993-d5b4-48be-b0c2-bdb904c28b81 00010000:00010000:1.0:1789428088.869597:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428088.869599:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428088.869600:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789428088.869606:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bfad6800/6c098993-d5b4-48be-b0c2-bdb904c28b81 for MGS 00000020:00000080:1.0:1789428088.869625:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bfad1800 for MGS 00000100:00100000:0.0:1789428088.869761:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869769:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869775:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869781:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869787:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869793:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869798:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869803:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869809:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869826:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869832:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869837:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869842:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869848:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869854:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869859:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869872:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869876:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869882:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869887:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869892:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869897:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869903:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869908:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869913:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869918:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869922:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869927:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869932:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869937:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869943:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869949:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869956:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869961:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869980:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869986:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869991:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.869997:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870001:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870006:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870011:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870017:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870022:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870027:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870032:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870037:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870042:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870047:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870053:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870059:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870065:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870077:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870082:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870088:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870094:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870100:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870105:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870110:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870115:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870120:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870125:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870130:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870135:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428088.870140:0:20727:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1789428088.871670:0:20727:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9195810e2cc0 - data ffff9196a9f876c0/ffff9196bbbb7400 00000020:01000000:0.0:1789428088.871788:0:20727:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9196bfaafa20 - data ffff9196bfc28e58/ffff919682b9b400 00000020:00000080:0.0:1789428088.872196:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5193d9 00000020:00000080:0.0:1789428088.872213:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196ad8c8800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789428088.872232:0:20727:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196bfad4800 from MGS, refs=2 00000020:01000004:0.0:1789428088.872235:0:20727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bfad4800 2 00000020:01000004:0.0:1789428088.872238:0:20727:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9196bfad4800 from MGS 00000020:00000080:0.0:1789428088.872374:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789428088.872382:0:20727:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789428088.872385:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196ad8ca000/MGS 00000020:00000080:0.0:1789428088.872387:0:20727:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad8ca000/MGS for MGS 00000020:01000000:0.0:1789428088.872395:0:20727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789428088.872478:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789428088.872482:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789428088.872487:0:20727:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789428088.872493:0:20727:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9196ad8c9000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789428088.872498:0:20727:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff9196bbde3380) has exports, disconnecting them 00000020:00080000:0.0:1789428088.872504:0:20727:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9196ad8c9000), last request at 1789428014 00000020:00000080:0.0:1789428088.872508:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5194dc 00000020:00080000:0.0:1789428088.872524:0:20727:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9196ad8c9000): rc 0 00000020:00000080:0.0:1789428088.872528:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196ad8c9000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789428088.873175:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad8c8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789428088.873184:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad8c9000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789428088.873456:0:20727:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789428088.873461:0:20727:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789428088.873465:0:20727:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789428088.873470:0:20727:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789428088.873488:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919690577800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789428088.873620:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789428088.873626:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789428088.873630:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196bcc88800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789428088.873633:0:20727:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bcc88800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789428088.873638:0:20727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789428088.873710:0:20727:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bfad4800 1 00000020:00000080:1.0:1789428088.873714:0:20727:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5193cb 00000020:00000080:1.0:1789428088.873719:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196ad8cc000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789428088.873726:0:20727:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789428088.873734:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196ad8cc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789428088.873741:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789428088.873744:0:20727:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789428088.873747:0:20727:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9196bf98b380) has no exports 00000020:00000080:1.0:1789428088.941008:0:20727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789428088.941019:0:20727:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789428088.941024:0:20727:0:(genops.c:885:class_export_put()) final put ffff9196bfad2000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789428088.941028:0:20727:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bfad2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789428088.941037:0:20727:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789428088.941130:0:20727:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9196bfad5800 00000020:02000400:1.0:1789428088.941293:0:20727:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789428089.589738:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428090.609585:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428091.185628:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940170112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789428091.185707:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428091.185790:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940170112 00000100:00100000:3.0:1789428091.185799:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940170112 00000100:00100000:3.0:1789428091.185857:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789428091.185867:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940170112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789428091.185897:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789428091.185941:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940170112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428091.185959:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789428091.185981:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789428091.186020:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940170112:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789428091.632700:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428091.697986:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:2.0:1789428091.698010:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:1.0:1789428091.698013:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940170240:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789428091.698017:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789428091.698023:0:8:0:(import.c:65:import_set_state_nolock()) ffff919583ec9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428091.698030:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 431 00000100:00080000:2.0:1789428091.698036:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789428091.698046:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff919583ec9000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428091.698072:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9195831bf480 x1876350940170496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789428091.698084:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789428091.698114:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789428091.698126:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789428091.698129:0:8:0:(import.c:65:import_set_state_nolock()) ffff9196b5aa9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428091.698133:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 431 00000100:00080000:2.0:1789428091.698136:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1789428091.698142:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940170368:0@lo:400:kworker.0 00000100:00080000:2.0:1789428091.698144:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9196b5aa9800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428091.698166:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958444a680 x1876350940170752/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000400:00000100:1.0:1789428091.698172:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876350940170368 offset 0 length 224: 4 00000100:00080000:2.0:1789428091.698195:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789428091.698199:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789428091.698201:0:8:0:(import.c:65:import_set_state_nolock()) ffff919582405000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428091.698206:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 431 00000100:00080000:2.0:1789428091.698209:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789428091.698216:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff919582405000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428091.698228:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940170240 00000100:00100000:2.0:1789428091.698229:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958444b100 x1876350940170880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789428091.698237:0:18668:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940170240 00000100:00080000:2.0:1789428091.698253:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789428091.698258:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789428091.698260:0:8:0:(import.c:65:import_set_state_nolock()) ffff919583355000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428091.698263:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 431 00000100:00080000:2.0:1789428091.698266:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789428091.698271:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff919583355000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428091.698283:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff919584449f80 x1876350940171136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789428091.698302:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789428091.698317:0:18668:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940170240:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789428091.698329:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940170496:0@lo:38:kworker.0 00002000:00000024:1.0:1789428091.698351:0:18668:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789428091.698379:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428091.698407:0:18668:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940170240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 94us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428091.698410:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940170752:0@lo:38:kworker.0 00000100:00100000:1.0:1789428091.698452:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789428091.698468:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789428091.698478:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789428091.698494:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940170880:0@lo:38:kworker.0 00000100:00100000:1.0:1789428091.698521:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940170240:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789428091.698530:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428091.698539:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789428091.698548:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940171264:0@lo:400:kworker.0 00000100:00100000:2.0:1789428091.698553:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940171136:0@lo:38:kworker.0 00000100:00100000:1.0:1789428091.698584:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428091.698594:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919584448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940170624:0@lo:400:kworker.0 00000100:00100000:2.0:1789428091.698625:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428091.698626:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940170752 00000100:00100000:1.0:1789428091.698631:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940170752 00000100:00100000:2.0:1789428091.698652:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789428091.698655:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940170880 00000100:00100000:1.0:1789428091.698659:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940170880 00000100:00100000:2.0:1789428091.698661:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940171008:0@lo:400:kworker.0 00000100:00100000:1.0:1789428091.698677:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940171264 00000100:00100000:1.0:1789428091.698681:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940171264 00000100:00100000:2.0:1789428091.698692:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428091.698713:0:17159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940171008 00000100:00100000:1.0:1789428091.698717:0:17159:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940171008 00000100:00100000:1.0:1789428091.698741:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789428091.698749:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940171264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428091.698794:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940171264:12345-0@lo:400:kworker.0 Request processed in 47us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428091.698801:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789428091.698814:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789428091.698821:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940171008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428091.698857:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940171008:12345-0@lo:400:kworker.0 Request processed in 37us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428091.698863:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789428091.698877:0:17159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789428091.698882:0:17159:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1876350940170752:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789428091.698899:0:17159:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789428091.699309:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940170496 00000100:00100000:0.0:1789428091.699314:0:17164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940170496 00000100:00100000:0.0:1789428091.699334:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789428091.699338:0:17164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1876350940170496:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789428091.699346:0:17164:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789428091.699374:0:17164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1876350940170496:12345-0@lo:38:kworker.0 Request processed in 36us (998us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789428091.699378:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789428091.699540:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789428091.699544:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3612:x1876350940170880:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789428091.699552:0:17160:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789428091.699575:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3612:x1876350940170880:12345-0@lo:38:kworker.0 Request processed in 30us (1050us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789428091.699579:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789428091.699621:0:18820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940170624 00000100:00100000:0.0:1789428091.699623:0:18820:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940170624 00000100:00100000:0.0:1789428091.699645:0:18820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789428091.699649:0:18820:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940170624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428091.699675:0:18820:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940170624:12345-0@lo:400:kworker.0 Request processed in 26us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428091.699679:0:18820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789428091.699743:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789428091.699997:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919583ec9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428091.700002:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789428091.700012:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9195831bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940170496:0@lo:38:kworker.0 00000100:00080000:0.0:1789428091.700023:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919582405000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428091.700032:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789428091.700034:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940170880:0@lo:38:kworker.0 00000100:00100000:0.0:1789428091.700052:0:17160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940171136 00000100:00100000:0.0:1789428091.700054:0:17160:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940171136 00000100:00100000:0.0:1789428091.700068:0:17160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789428091.700071:0:17160:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3612:x1876350940171136:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789428091.700078:0:17160:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789428091.700099:0:17160:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3612:x1876350940171136:12345-0@lo:38:kworker.0 Request processed in 28us (357us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789428091.700103:0:17160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1789428091.700117:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919583355000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428091.700120:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789428091.700123:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940171136:0@lo:38:kworker.0 00000100:00080000:0.0:1789428091.700145:0:17155:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789428091.700164:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff91958444a300 x1876350940171008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428091.700185:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940171008:0@lo:400:kworker.0 00000100:00100000:0.0:1789428091.700196:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919584448380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940170624:0@lo:400:kworker.0 00010000:00080000:2.0:1789428091.700335:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff91958444ce00 x1876350940171264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428091.700347:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940171264:0@lo:400:kworker.0 00000100:00100000:1.0:1789428091.719648:0:17159:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1876350940170752:12345-0@lo:38:kworker.0 Request processed in 20757us (21173us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789428091.719663:0:17159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789428091.719881:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b5aa9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428091.719890:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789428091.719895:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940170752:0@lo:38:kworker.0 00000020:01000004:2.0:1789428091.779812:0:20928:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789428091.794528:0:20928:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789428091.794585:0:20928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428091.794598:0:20928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428091.794603:0:20928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428091.794608:0:20928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428091.794639:0:20928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789428091.794650:0:20928:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789428091.794671:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789428091.794675:0:20928:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789428091.794680:0:20928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789428091.794686:0:20928:0:(import.c:65:import_set_state_nolock()) ffff9196b5aa9800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789428091.794690:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789428091.794691:0:20928:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789428091.794693:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789428091.795569:0:20928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.795832:0:20928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.795840:0:20928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.795847:0:20928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.795871:0:20928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789428091.795879:0:20928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.795886:0:20928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.795893:0:20928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.795900:0:20928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.795916:0:20928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789428091.795921:0:20928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.795927:0:20928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.795945:0:20928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428091.796031:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789428091.796039:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428091.796047:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fc00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:3.0:1789428091.796050:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428091.796060:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789428091.796068:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428091.796073:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789428091.796076:0:17148:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789428091.796078:0:17148:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789428091.796166:0:20928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.796189:0:20928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789428091.796194:0:20928:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.796202:0:20928:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.796209:0:20928:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.796215:0:20928:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428091.796221:0:20928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1789428091.796224:0:20928:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:1.0:1789428091.796246:0:20182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:01000004:0.0:1789428091.796251:0:20928:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00010000:00010000:1.0:1789428091.796254:0:20182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1789428091.796256:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1789428091.796263:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:1.0:1789428091.796265:0:20182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428091.796270:0:20182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789428091.796270:0:20928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1789428091.796280:0:20928:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff919583351000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1789428091.796281:0:20182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789428091.796292:0:20928:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff919582437000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:1.0:1789428091.796294:0:20182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789428091.796301:0:20928:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff9196bcb44d40) has exports, disconnecting them 10000000:01000000:1.0:1789428091.796303:0:20182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789428091.796305:0:20182:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:1.0:1789428091.796307:0:20182:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00000020:00080000:0.0:1789428091.796315:0:20928:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff919583351000), last request at 1789428091 00000020:00000080:0.0:1789428091.796324:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519808 00010000:00010000:1.0:1789428091.796336:0:20182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796343:0:20182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:0.0:1789428091.796345:0:20928:0:(import.c:65:import_set_state_nolock()) ffff919583353800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789428091.796374:0:20182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796382:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff91958375c800/0x84fc867ede519529 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede519530 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796396:0:20182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00080000:0.0:1789428091.796396:0:20928:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff919583351000): rc 0 00000020:00000080:0.0:1789428091.796399:0:20928:0:(genops.c:885:class_export_put()) final put ffff919583351000/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:1.0:1789428091.796407:0:20182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796437:0:20182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46e00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428091.796440:0:20182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796447:0:20182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428091.796453:0:20182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428091.796458:0:20182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789428091.796460:0:20182:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789428091.796462:0:20182:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789428091.796476:0:20182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796482:0:20182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789428091.796498:0:20182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796505:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583f46e00/0x84fc867ede519816 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede51981d expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796518:0:20182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789428091.796521:0:20182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796527:0:20182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428091.796535:0:20182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796543:0:20182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428091.796550:0:20182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428091.796555:0:20182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789428091.796557:0:20182:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789428091.796559:0:20182:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789428091.796570:0:20182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796576:0:20182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789428091.796582:0:20182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796588:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583429600/0x84fc867ede5199c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5199c8 expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796596:0:20182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428091.796599:0:20182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796604:0:20182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428091.796607:0:20182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796613:0:20182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428091.796627:0:20182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428091.796632:0:20182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789428091.796634:0:20182:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789428091.796636:0:20182:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789428091.796648:0:20182:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796654:0:20182:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789428091.796659:0:20182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796666:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff91958375c600/0x84fc867ede51951b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede519522 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428091.796676:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428091.796678:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428091.796680:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428091.796700:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940171392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428091.796777:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428091.796822:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789428091.796829:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940171776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428091.796849:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428091.796888:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940171520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428091.796908:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428091.796925:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789428091.796930:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940171648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428091.796955:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789428091.796975:0:20928:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff919582437000), last request at 1789428091 00000020:00000080:0.0:1789428091.796983:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5196b1 00000100:00100000:1.0:1789428091.796988:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940171392 00000100:00080000:0.0:1789428091.796992:0:20928:0:(import.c:65:import_set_state_nolock()) ffff9196b5b0a800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789428091.796996:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940171392 00000020:00080000:0.0:1789428091.797009:0:20928:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff919582437000): rc 0 00000020:00000080:0.0:1789428091.797012:0:20928:0:(genops.c:885:class_export_put()) final put ffff919582437000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1789428091.797021:0:20928:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb489c1667ae0 00000100:00100000:1.0:1789428091.797038:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940171776 00000100:00080000:0.0:1789428091.797039:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789428091.797044:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940171776 00000100:00100000:0.0:1789428091.797044:0:20928:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1789428091.797057:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940171520 00000100:00100000:1.0:1789428091.797061:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940171520 00000100:00100000:1.0:1789428091.797068:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940171648 00000100:00100000:1.0:1789428091.797070:0:17144:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940171648 00000100:00100000:1.0:1789428091.797082:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789428091.797089:0:17144:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3616:x1876350940171392:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789428091.797095:0:17144:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789428091 with bad export cookie 9582681986591462389 00010000:00010000:2.0:1789428091.797741:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789428091.797928:0:20928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789428091.797934:0:20928:0:(import.c:65:import_set_state_nolock()) ffff919583ec9000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00100000:0.0:1789428091.797996:0:20183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789428091.798003:0:20183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3616:x1876350940171776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789428091.798010:0:20183:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789428091 with bad export cookie 9582681986591462389 00000100:00100000:0.0:1789428091.798067:0:20183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3616:x1876350940171776:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (1217us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789428091.798074:0:20183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789428091.798096:0:20183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789428091.798099:0:20183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3613:x1876350940171520:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789428091.798103:0:20183:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789428091 with bad export cookie 9582681986591462389 00000100:00100000:0.0:1789428091.798129:0:20183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3613:x1876350940171520:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (1219us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789428091.798136:0:20183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789428091.798161:0:20183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789428091.798166:0:20183:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3613:x1876350940171648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789428091.798170:0:20183:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789428091 with bad export cookie 9582681986591462389 00000100:00100000:0.0:1789428091.798207:0:20183:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3613:x1876350940171648:12345-0@lo:103:ldlm_bl.0 Request processed in 40us (1251us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789428091.798212:0:20183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789428091.798295:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789428091.798298:0:20928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1789428091.798312:0:20928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789428091.798376:0:20928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789428091.798393:0:20928:0:(import.c:65:import_set_state_nolock()) ffff9196b5aab000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789428091.798435:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789428091.798438:0:20928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1789428091.798446:0:20928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789428091.798503:0:20928:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789428091.798513:0:20928:0:(import.c:65:import_set_state_nolock()) ffff9196b5b0e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789428091.798551:0:20928:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9196bcb44d40) has no exports 00000100:00080000:0.0:1789428091.798596:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.124@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789428091.798600:0:3616:0:(import.c:65:import_set_state_nolock()) ffff919584424000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789428091.798603:0:3616:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.124@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1789428091.799343:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940171904:0@lo:9:umount.0 00000100:00100000:2.0:1789428091.799392:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428091.799438:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940172032:0@lo:9:umount.0 00000100:00100000:2.0:1789428091.799460:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428091.800218:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940171904 00000100:00100000:2.0:1789428091.800227:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940171904 00000100:00100000:2.0:1789428091.800273:0:18665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940172032 00000100:00100000:2.0:1789428091.800277:0:18665:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940172032 00000100:00100000:2.0:1789428091.800298:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789428091.800307:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3612:x1876350940171904:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789428091.800333:0:18665:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519798 00000100:00080000:2.0:1789428091.800342:0:18665:0:(import.c:65:import_set_state_nolock()) ffff9196bbb87800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789428091.800384:0:18665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789428091.800551:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3612:x1876350940171904:12345-0@lo:9:umount.0 Request processed in 244us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428091.800559:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789428091.800588:0:18665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789428091.800594:0:18665:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3612:x1876350940172032:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789428091.800605:0:18665:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519839 00000100:00080000:2.0:1789428091.800612:0:18665:0:(import.c:65:import_set_state_nolock()) ffff919583356800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789428091.800626:0:18665:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1789428091.800700:0:18665:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3612:x1876350940172032:12345-0@lo:9:umount.0 Request processed in 106us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428091.800706:0:18665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1789428091.800732:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789428091.800771:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b5aab000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789428091.800779:0:3612:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789428091.800780:0:3612:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789428091.802999:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940171904:0@lo:9:umount.0 00000100:00080000:2.0:1789428091.803115:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196b5b0e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789428091.803122:0:3612:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789428091.803124:0:3612:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789428091.803188:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940172032:0@lo:9:umount.0 00000020:00000080:2.0:1789428091.803817:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff919583351000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:2.0:1789428091.804328:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff919582437000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:2.0:1789428091.804354:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583353800 for lustre-MDT0001 00000020:00000080:2.0:1789428091.804359:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196b5b0a800 for lustre-MDT0001 00000100:00080000:2.0:1789428091.809594:0:3613:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.124@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1789428091.811273:0:17144:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3616:x1876350940171392:12345-0@lo:103:ldlm_bl.0 Request processed in 14180us (14493us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789428091.811287:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789428091.812464:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789428091.826713:0:3616:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.124@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789428091.826720:0:3616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789428091.826729:0:3616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff919583cb8380 x1876350940170368/t0(0) o400->MGC192.168.202.124@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789428107 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428091.826744:0:3616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91958361ea00 x1876350940171392/t0(0) o103->MGC192.168.202.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789428107 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428091.826752:0:3616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91958361ce00 x1876350940171776/t0(0) o103->MGC192.168.202.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789428107 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428091.826778:0:3616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91958361d880 x1876350940171520/t0(0) o103->MGC192.168.202.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789428107 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428091.826788:0:3616:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91958361c700 x1876350940171648/t0(0) o103->MGC192.168.202.124@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789428107 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789428091.827167:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789428091.827179:0:3616:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789428091.827181:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789428091.827265:0:3616:0:(import.c:65:import_set_state_nolock()) ffff919584424000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789428091.827270:0:3616:0:(import.c:545:import_select_connection()) MGC192.168.202.124@tcp: connect to NID 0@lo last attempt 358 00000100:00080000:0.0:1789428091.827285:0:3616:0:(import.c:666:import_select_connection()) MGC192.168.202.124@tcp: import ffff919584424000 using connection 192.168.202.124@tcp/0@lo 00000100:00080000:2.0:1789428091.827367:0:3613:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff919584424000 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:2.0:1789428091.827440:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940171520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428091.827469:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6c098993-d5b4-48be-b0c2-bdb904c28b81:3613:1876350940171648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428091.827631:0:3616:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfb8ed80 x1876350940172288/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789428091.827657:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940171392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428091.827666:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583cb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940170368:0@lo:400:kworker.0 00000100:00100000:1.0:1789428091.827676:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c098993-d5b4-48be-b0c2-bdb904c28b81:3612:1876350940172288:0@lo:250:ptlrpcd_00_03.0 00000100:00100000:0.0:1789428091.827681:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:3616:1876350940171776:0@lo:103:ldlm_bl.0 00000400:00000100:1.0:1789428091.827723:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876350940172288 offset 0 length 520: 4 00010000:00010000:3.0:1789428091.827802:0:17148:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428091.827813:0:17148:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789428091.827848:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6c098993-d5b4-48be-b0c2-bdb904c28b81:0:1876350940172160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428091.827883:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428091.827892:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede5195ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x84fc867ede5195d1 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428091.827919:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428091.827921:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428091.827923:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789428091.841829:0:20928:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9196bcb44d40) has no exports 00000020:01000000:1.0:1789428091.885764:0:20928:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff91968b37e240 - data ffff9195820a5360/ffff9196bbb9f000 00000020:01000000:1.0:1789428091.885925:0:20928:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9196b6382060 - data ffff9196a9d4f000/ffff919686e30c00 00000001:00000004:1.0:1789428091.898712:0:20928:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1789428091.943350:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789428091.943365:0:20928:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789428091.943372:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789428091.947061:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789428091.947068:0:20928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1789428091.947631:0:20928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789428091.947635:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789428091.948197:0:17900:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789428091.948202:0:17900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:3.0:1789428091.948214:0:17900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789428091.949761:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789428091.949768:0:20928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789428091.949879:0:20928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789428091.949883:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789428091.950194:0:17902:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789428091.950198:0:17902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1789428091.950208:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789428091.952050:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51953e 00000020:00000080:2.0:1789428091.952061:0:20928:0:(genops.c:885:class_export_put()) final put ffff919692afd000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789428091.952732:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519553 00000020:00000080:2.0:1789428091.952738:0:20928:0:(genops.c:885:class_export_put()) final put ffff9196a0532000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789428091.953045:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919692afd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789428091.953109:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789428091.953116:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789428091.953124:0:20928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789428091.953128:0:20928:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9196bcb40000) has no exports 00000004:01000000:2.0:1789428091.953295:0:20928:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789428091.953303:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5195a7 00000020:00000080:2.0:1789428091.953308:0:20928:0:(genops.c:885:class_export_put()) final put ffff9196b5b0d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789428091.953507:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196a0532000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1789428091.953629:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789428091.953635:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789428091.953639:0:20928:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789428091.953642:0:20928:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff9196884519c0) has no exports 00000020:00000080:2.0:1789428091.953647:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5195a0 00000020:00000080:2.0:1789428091.953651:0:20928:0:(genops.c:885:class_export_put()) final put ffff9196b5b0a000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789428091.953673:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b5b0d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:2.0:1789428091.954070:0:20928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789428091.954075:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789428091.954079:0:20928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1789428091.954085:0:20928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789428091.954087:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789428091.954236:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b5b0a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789428091.954456:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789428091.954464:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789428091.954470:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519592 00000020:00000080:2.0:1789428091.954475:0:20928:0:(genops.c:885:class_export_put()) final put ffff919583ece000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789428091.954506:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196b5b0e000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1789428091.954512:0:8:0:(genops.c:885:class_export_put()) final put ffff919583eca000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789428091.954514:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919583eca000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1789428091.954518:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789428091.954701:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789428091.954706:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789428091.954710:0:20928:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789428091.954713:0:20928:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9196888919c0) has no exports 00000020:00000080:2.0:1789428091.954717:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51958b 00000020:00000080:2.0:1789428091.954721:0:20928:0:(genops.c:885:class_export_put()) final put ffff919687fbd000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789428091.954739:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919583ece000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:2.0:1789428091.955170:0:20928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789428091.955184:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789428091.955187:0:20928:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1789428091.955191:0:20928:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789428091.955193:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789428091.955472:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919687fbd000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789428091.955616:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789428091.955623:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789428091.955635:0:20928:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789428091.955640:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519576 00000020:00000080:2.0:1789428091.955646:0:20928:0:(genops.c:885:class_export_put()) final put ffff919583eca800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789428091.955650:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789428091.955654:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789428091.955659:0:20928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789428091.955662:0:20928:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff919688454d40) has no exports 00000020:00000080:2.0:1789428091.955666:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51956f 00000020:00000080:2.0:1789428091.955668:0:20928:0:(genops.c:885:class_export_put()) final put ffff919583ecf000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1789428091.957647:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196b5aab000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1789428091.957660:0:8:0:(genops.c:885:class_export_put()) final put ffff9196a0530800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789428091.957663:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196a0530800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1789428091.957670:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789428091.957754:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919583eca800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1789428091.957760:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919583ecf000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789428091.958486:0:20928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:3.0:1789428091.958502:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789428091.958506:0:20928:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789428091.958512:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789428091.958685:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789428091.958696:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789428091.958728:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789428091.958732:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789428091.958735:0:20928:0:(genops.c:885:class_export_put()) final put ffff9196bcc8c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789428091.958738:0:20928:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bcc8c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1789428091.958743:0:20928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789428091.958871:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51955a 00000020:00000080:3.0:1789428091.958879:0:20928:0:(genops.c:885:class_export_put()) final put ffff9196a0536000/lustre-MDD0001_UUID 00000020:00000080:0.0:1789428091.959075:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583ec9000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789428091.959083:0:8:0:(genops.c:885:class_export_put()) final put ffff919583ecc000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789428091.959085:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919583ecc000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789428091.959094:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789428091.959256:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1789428091.959261:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789428091.959266:0:20928:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789428091.959276:0:20928:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9196bcb419c0) has no exports 00000020:00000080:3.0:1789428091.959307:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789428091.959312:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1789428091.959316:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519561 00000020:00000080:3.0:1789428091.959321:0:20928:0:(genops.c:885:class_export_put()) final put ffff9196a0533000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1789428091.959328:0:20928:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919698b0d800 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1789428091.959332:0:20928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919698b0d800 2 00000020:01000004:3.0:1789428091.959335:0:20928:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff919698b0d800 from lustre-MDT0001 00000020:00000080:3.0:1789428091.959364:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789428091.959367:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1789428091.959370:0:20928:0:(genops.c:885:class_export_put()) final put ffff919692afa000/lustre-MDT0001_UUID 00000020:00000080:3.0:1789428091.959372:0:20928:0:(genops.c:844:class_export_destroy()) destroying export ffff919692afa000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1789428091.959379:0:20928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1789428091.959409:0:20928:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1789428091.959433:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1789428091.959437:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789428091.959440:0:20928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789428091.959453:0:20928:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9196905ae000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789428091.959458:0:20928:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff919688893380) has exports, disconnecting them 00000020:00080000:3.0:1789428091.959463:0:20928:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9196905ae000), last request at 1789428025 00000020:00000080:3.0:1789428091.959467:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5195df 00000020:00080000:3.0:1789428091.959478:0:20928:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9196905ae000): rc 0 00000020:00000080:3.0:1789428091.959481:0:20928:0:(genops.c:885:class_export_put()) final put ffff9196905ae000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789428091.959629:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196a0536000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1789428091.959634:0:8:0:(genops.c:885:class_export_put()) final put ffff919687fbf800/lustre-MDD0001_UUID 00000020:00000080:0.0:1789428091.959636:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919687fbf800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1789428091.959641:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1789428091.959767:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196a0533000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789428091.959771:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196905ae000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789428091.965558:0:20928:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789428091.965568:0:20928:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789428091.965573:0:20928:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789428091.965580:0:20928:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789428091.965612:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196b5aa9800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789428091.965807:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789428091.965816:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789428091.965821:0:20928:0:(genops.c:885:class_export_put()) final put ffff9196b5aad800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789428091.965825:0:20928:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b5aad800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789428091.965831:0:20928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789428091.965903:0:20928:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919698b0d800 1 00000020:00000080:0.0:1789428091.965909:0:20928:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519506 00000020:00000080:0.0:1789428091.965916:0:20928:0:(genops.c:885:class_export_put()) final put ffff9196905a9800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789428091.965924:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789428091.965932:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9196905a9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789428091.965940:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789428091.965945:0:20928:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789428091.965949:0:20928:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff919581ddcd40) has no exports 00000020:00000080:0.0:1789428091.984857:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789428091.984872:0:20928:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789428091.984878:0:20928:0:(genops.c:885:class_export_put()) final put ffff919584423800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789428091.984883:0:20928:0:(genops.c:844:class_export_destroy()) destroying export ffff919584423800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789428091.984892:0:20928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789428091.985146:0:20928:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff919698b09800 00000020:01000000:0.0:1789428091.985164:0:20928:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789428091.985168:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789428091.985182:0:20928:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789428091.985187:0:20928:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9196bcb43380) has no exports 00000100:00100000:3.0:1789428091.985382:0:19948:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff919582673600:19948] 3 exiting: rc = 0 00000100:00100000:2.0:1789428091.985641:0:17160:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9196bc80ae00:17160] 1 exiting: rc = 0 00000100:00100000:2.0:1789428091.985698:0:17161:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9196bc80be00:17161] 2 exiting: rc = 0 00000100:00100000:1.0:1789428091.986270:0:17159:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9196bc80a400:17159] 0 exiting: rc = 1 00000100:00100000:0.0:1789428091.986644:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986652:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986669:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986676:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986691:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986698:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986709:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986714:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986723:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986729:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986735:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986739:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986744:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986757:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986762:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986771:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986944:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986963:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986969:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986974:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986979:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986985:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986989:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.986994:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987000:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987005:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987010:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987016:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987023:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987028:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987034:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987040:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987046:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987051:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987056:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987074:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987079:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987084:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987089:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987094:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987099:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987104:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987108:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987113:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987118:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987123:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987129:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987134:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987139:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987143:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987148:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987153:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987158:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987163:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987168:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987184:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987190:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987196:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987201:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987205:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987210:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987216:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987222:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.987228:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428091.992876:0:17163:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9196bc80b200:17163] 1 exiting: rc = 0 00000100:00100000:3.0:1789428091.993301:0:17162:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9196bc80a800:17162] 0 exiting: rc = 1 00000100:00100000:0.0:1789428091.993823:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993832:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993839:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993844:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993849:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993854:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993870:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993874:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993880:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993884:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993890:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993895:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993901:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993906:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993911:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993917:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993922:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993927:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993932:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993937:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993942:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993947:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993952:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993957:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993962:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993967:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993973:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993979:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993985:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993990:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.993997:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994003:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994009:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994014:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994021:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994026:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994032:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994037:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994043:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994049:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994055:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994067:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994073:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994079:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994084:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994089:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994094:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994099:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994105:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994110:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994116:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994121:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994126:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994131:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994137:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994143:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994148:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994154:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994158:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994164:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994169:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994818:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994828:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.994834:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428091.995586:0:17164:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9195837fd400:17164] 0 exiting: rc = 1 00000100:00100000:2.0:1789428091.995830:0:17165:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9196bc80a000:17165] 1 exiting: rc = 0 00000100:00100000:0.0:1789428091.995969:0:17899:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff9196ad051c00:17899] 2 exiting: rc = 0 00000100:00100000:0.0:1789428091.996024:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996031:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996037:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996043:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996060:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996068:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996073:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996082:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996088:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996095:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996100:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996117:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996123:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996129:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996135:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996141:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996161:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996169:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996186:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996193:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996200:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996205:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996210:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996327:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996335:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996340:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996346:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996352:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996373:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996381:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996386:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996392:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996398:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996405:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996411:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996508:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996515:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996522:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996527:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996533:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996675:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996684:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996690:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996696:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996702:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996707:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996724:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996731:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996739:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996744:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996750:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996757:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996778:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996785:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996791:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996798:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996804:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996810:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996815:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996821:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996827:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996833:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996840:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428091.996846:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428092.018810:0:17166:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff91958242d800:17166] 0 exiting: rc = 1 00000100:00100000:3.0:1789428092.018819:0:17167:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff91958242ce00:17167] 1 exiting: rc = 0 00000100:00100000:2.0:1789428092.019004:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019014:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019033:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019040:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019047:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019057:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019064:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019074:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019082:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019092:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019101:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019110:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019121:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019126:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019131:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019180:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019187:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019192:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019197:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019202:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019210:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019370:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019376:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019381:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019385:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019390:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019395:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019400:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019406:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019410:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019478:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019484:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019490:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019495:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019500:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019505:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019511:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019524:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019528:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019534:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019538:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019543:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019548:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019553:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019557:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019562:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019566:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019571:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019576:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019581:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019585:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019590:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019701:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019714:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019721:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019728:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019734:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019741:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019749:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019756:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019763:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019770:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019777:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.019782:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428092.020910:0:17169:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff91958242c400:17169] 1 exiting: rc = 0 00000100:00100000:0.0:1789428092.021017:0:17168:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9196c198ea00:17168] 0 exiting: rc = 1 00000100:00100000:2.0:1789428092.021188:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021197:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021205:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021319:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021328:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021333:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021338:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021344:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021359:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021364:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021369:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021374:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021379:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021385:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021390:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021396:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021400:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021405:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021410:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021470:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021477:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021482:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021488:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021494:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021500:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021505:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021509:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021514:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021519:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021525:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021532:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021684:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021696:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021703:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021709:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021716:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021722:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021728:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021735:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021742:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021748:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021756:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021763:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021777:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021782:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021786:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021791:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021795:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021800:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021805:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021810:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021814:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021819:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021824:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021829:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021834:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021839:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021844:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021850:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021857:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021866:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021873:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021950:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.021956:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428092.022748:0:17170:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9196a2344400:17170] 0 exiting: rc = 1 00000100:00100000:3.0:1789428092.022749:0:17171:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9196a2344a00:17171] 1 exiting: rc = 0 00000100:00100000:2.0:1789428092.022836:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.022845:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.022852:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.022861:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.022869:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.022941:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.022950:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.022957:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.022962:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.022967:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.022972:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.022977:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.022983:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.022988:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023002:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023007:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023013:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023020:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023026:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023033:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023040:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023046:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023053:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023059:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023067:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023075:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023082:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023089:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023096:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023103:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023112:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023122:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023132:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023139:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023144:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023151:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023155:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023161:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023166:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023182:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023188:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023193:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023198:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023203:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023224:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023299:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023304:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023309:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023314:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023325:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023330:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023335:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023339:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023343:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023348:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023353:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023358:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023362:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023368:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023372:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023376:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023380:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023385:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.023390:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428092.024285:0:17174:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9196c1a7ca00:17174] 2 exiting: rc = 0 00000100:00100000:0.0:1789428092.024448:0:17172:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9196c1a7c000:17172] 0 exiting: rc = 1 00000100:00100000:2.0:1789428092.024676:0:17173:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9196c1a7c200:17173] 1 exiting: rc = 0 00000100:00100000:2.0:1789428092.024777:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024786:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024791:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024796:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024801:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024809:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024817:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024825:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024833:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024840:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024849:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024857:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024865:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024871:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024947:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024961:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024968:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024973:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.024984:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025028:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025035:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025042:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025050:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025057:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025086:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025096:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025104:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025110:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025118:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025125:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025132:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025140:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025151:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025157:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025168:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025186:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025193:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025201:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025210:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025221:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025306:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025314:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025321:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025329:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025336:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025343:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025348:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025354:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025374:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025380:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025385:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025391:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025397:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025403:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025468:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025476:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025484:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025491:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025498:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025506:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025512:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025518:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025525:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428092.025531:0:20928:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789428092.037558:0:20928:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789428092.037574:0:20928:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789428092.037580:0:20928:0:(genops.c:885:class_export_put()) final put ffff9196adaed800/MDS_uuid 00000020:00000080:2.0:1789428092.037584:0:20928:0:(genops.c:844:class_export_destroy()) destroying export ffff9196adaed800/MDS_uuid for MDS 00000020:01000000:2.0:1789428092.037591:0:20928:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789428092.038091:0:20928:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1789428092.656528:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428093.680988:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428094.704566:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789428095.035897:0:21129:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789428095.048671:0:21129:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1789428095.048726:0:21129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428095.048738:0:21129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428095.048743:0:21129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428095.048748:0:21129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428095.048803:0:21129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789428095.048809:0:21129:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789428095.048837:0:21129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789428095.048855:0:21129:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789428095.048860:0:21129:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789428095.048865:0:21129:0:(import.c:65:import_set_state_nolock()) ffff919582405000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789428095.048869:0:21129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789428095.048871:0:21129:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789428095.048873:0:21129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789428095.049596:0:21129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789428095.049598:0:21129:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789428095.049602:0:21129:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789428095.049621:0:21129:0:(import.c:65:import_set_state_nolock()) ffff919582406800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789428095.049895:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3612:1876350940172416:0@lo:39:umount.0 00000400:00000100:1.0:1789428095.049944:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940172416 offset 0 length 224: 4 00010000:00010000:0.0:1789428095.050211:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428095.050219:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428095.050226:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ece00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789428095.050230:0:17147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428095.050238:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789428095.050256:0:17147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428095.050259:0:17147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789428095.050261:0:17147:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789428095.050263:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789428095.050276:0:17147:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff919584424000 00010000:00010000:0.0:1789428095.050279:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428095.050283:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede519679 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede519680 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428095.050398:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428095.050401:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428095.050407:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428095.729175:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428096.752824:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789428096.818687:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c098993-d5b4-48be-b0c2-bdb904c28b81->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789428096.818700:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6c098993-d5b4-48be-b0c2-bdb904c28b81->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789428096.818706:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789428096.818711:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789428096.818716:0:8:0:(import.c:65:import_set_state_nolock()) ffff919583355000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789428096.818726:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 436 00000100:00080000:1.0:1789428096.818734:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789428096.818748:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff919583355000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428096.818792:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958361ca80 x1876350940172544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789428096.818955:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940172672:0@lo:400:kworker.0 00000100:00100000:2.0:1789428096.819156:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940172544:0@lo:38:kworker.0 00000400:00000100:3.0:1789428096.819176:0:3613:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940172672 offset 0 length 224: 4 00000400:00000100:2.0:1789428096.819220:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940172544 offset 0 length 520: 4 00000001:00100000:2.0:1789428097.333205:0:19476:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789428097.333215:0:19476:0:(genops.c:885:class_export_put()) final put ffff919583352800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789428097.333380:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff919583352800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789428097.333456:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583356800 for lustre-OST0001 00000001:00100000:1.0:1789428097.333804:0:18659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789428097.333809:0:18659:0:(genops.c:885:class_export_put()) final put ffff9196bbb85000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789428097.333864:0:469:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bbb85000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789428097.333897:0:469:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9196bbb87800 for lustre-OST0000 00010000:00010000:1.0:1789428097.777495:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428098.801927:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428099.824594:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428100.849005:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428101.872973:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428101.937135:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428091/real 1789428091] req@ffff9196bfb8ed80 x1876350940172288/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789428101 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428101.937190:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9196bfb8ed80 x1876350940172288/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789428101 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789428101.937213:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919584424000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428101.937222:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789428101.937226:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c098993-d5b4-48be-b0c2-bdb904c28b81:3612:1876350940172288:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1789428101.937337:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c098993-d5b4-48be-b0c2-bdb904c28b81->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789428101.937346:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789428101.937350:0:37:0:(import.c:65:import_set_state_nolock()) ffff919584424000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789428101.937356:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.124@tcp: connect to NID 0@lo last attempt 436 00000100:00080000:3.0:1789428101.937364:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.124@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789428101.937379:0:37:0:(import.c:666:import_select_connection()) MGC192.168.202.124@tcp: import ffff919584424000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428101.937454:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfa83b80 x1876350940172800/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789428101.938108:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c098993-d5b4-48be-b0c2-bdb904c28b81:3612:1876350940172800:0@lo:250:kworker.0 00000400:00000100:0.0:1789428101.938173:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876350940172800 offset 0 length 520: 4 00000100:00080000:3.0:1789428101.938283:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789428101.938307:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789428101.938567:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789428101.938580:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940172928:0@lo:400:kworker.0 00000400:00000100:3.0:1789428101.938609:0:3613:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940172928 offset 0 length 224: 4 00010000:00010000:3.0:1789428102.896813:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428103.922569:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428104.948266:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428105.008720:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428095/real 1789428095] req@ffff91958444e680 x1876350940172416/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789428105 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428105.008763:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91958444e680 x1876350940172416/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789428105 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789428105.008812:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919582406800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789428105.008833:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3612:1876350940172416:0@lo:39:umount.0 00000100:00080000:2.0:1789428105.009044:0:21129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789428105.009062:0:21129:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789428105.009069:0:21129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789428105.010125:0:21129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428105.010143:0:21129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428105.010150:0:21129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428105.010176:0:21129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428105.010203:0:21129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428105.010213:0:21129:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428105.010220:0:21129:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428105.010226:0:21129:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428105.010232:0:21129:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428105.010253:0:21129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789428105.010259:0:21129:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789428105.010301:0:21129:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789428105.010306:0:21129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1789428105.010312:0:21129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789428105.010319:0:21129:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789428105.010325:0:21129:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9196bbde0000) has no exports 00000020:00080000:2.0:1789428105.010362:0:21129:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff9196bbde0000) has no exports 00010000:00010000:1.0:1789428105.011500:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789428105.011514:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428105.011525:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428105.011544:0:17147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428105.011556:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428105.011565:0:17147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428105.011572:0:17147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789428105.011575:0:17147:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789428105.011579:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789428105.011602:0:17147:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff919584424000 00010000:00010000:1.0:1789428105.011607:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428105.011614:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff9196813ed000/0x84fc867ede51964f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede519656 expref: -99 pid: 18658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428105.011781:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428105.011785:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428105.011792:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428105.011795:0:17147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428105.011802:0:17147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428105.011809:0:17147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428105.011821:0:17147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789428105.011824:0:17147:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789428105.011826:0:17147:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789428105.011834:0:17147:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff919584424000 00010000:00010000:1.0:1789428105.011838:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428105.011844:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede5199b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede5199ba expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428105.011855:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428105.011857:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428105.011859:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428105.012680:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789428105.013329:0:21129:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9195810e2660 - data ffff91968aeaa288/ffff9196bbbb5000 00000020:01000000:2.0:1789428105.013556:0:21129:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff919688817c60 - data ffff9196897135e8/ffff9196b64f7c00 00100000:10000000:2.0:1789428105.021530:0:21129:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789428105.029002:0:21129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519664 00000020:00000080:0.0:1789428105.029018:0:21129:0:(genops.c:885:class_export_put()) final put ffff919583043800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789428105.029042:0:21129:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196b5b09800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789428105.029046:0:21129:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196b5b09800 2 00000020:01000004:0.0:1789428105.029049:0:21129:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9196b5b09800 from lustre-OST0000 00000020:00000080:0.0:1789428105.029080:0:21129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789428105.029089:0:21129:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789428105.029092:0:21129:0:(genops.c:885:class_export_put()) final put ffff9196adde5000/lustre-OST0000_UUID 00000020:00000080:0.0:1789428105.029095:0:21129:0:(genops.c:844:class_export_destroy()) destroying export ffff9196adde5000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789428105.029101:0:21129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:3.0:1789428105.029163:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff919583043800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:0.0:1789428105.029167:0:21129:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789428105.029177:0:21129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789428105.029181:0:21129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789428105.029187:0:21129:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789428105.029194:0:21129:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff919582401000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789428105.029200:0:21129:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff919688890000) has exports, disconnecting them 00000020:00080000:0.0:1789428105.029205:0:21129:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff919582401000), last request at 1789428037 00000020:00000080:0.0:1789428105.029210:0:21129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede51968e 00000020:00080000:0.0:1789428105.029220:0:21129:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff919582401000): rc 0 00000020:00000080:0.0:1789428105.029225:0:21129:0:(genops.c:885:class_export_put()) final put ffff919582401000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789428105.029762:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff919582401000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1789428105.033548:0:21129:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789428105.033561:0:21129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789428105.033567:0:21129:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789428105.033579:0:21129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789428105.033959:0:21129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789428105.033976:0:21129:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1789428105.033986:0:21129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789428105.033999:0:21129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789428105.034004:0:21129:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789428105.034019:0:21129:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff919582400800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789428105.034027:0:21129:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff919688894d40) has exports, disconnecting them 00000020:00080000:1.0:1789428105.034033:0:21129:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff919582400800), last request at 1789428037 00000020:00000080:1.0:1789428105.034043:0:21129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5196a3 00000020:00080000:1.0:1789428105.034079:0:21129:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff919582400800): rc 0 00000020:00000080:1.0:1789428105.034086:0:21129:0:(genops.c:885:class_export_put()) final put ffff919582400800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789428105.035506:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919582405000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789428105.035523:0:37:0:(genops.c:885:class_export_put()) final put ffff91968382b000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789428105.035526:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff91968382b000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789428105.035534:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789428105.036681:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff919582400800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1789428105.046526:0:21129:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789428105.046536:0:21129:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789428105.046541:0:21129:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789428105.046549:0:21129:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789428105.046601:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919582406800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1789428105.046822:0:21129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789428105.046834:0:21129:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1789428105.046840:0:21129:0:(genops.c:885:class_export_put()) final put ffff919582407000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1789428105.046844:0:21129:0:(genops.c:844:class_export_destroy()) destroying export ffff919582407000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1789428105.046851:0:21129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1789428105.046921:0:21129:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196b5b09800 1 00000020:00000080:3.0:1789428105.046927:0:21129:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519641 00000020:00000080:3.0:1789428105.046934:0:21129:0:(genops.c:885:class_export_put()) final put ffff9196adde4800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1789428105.046943:0:21129:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1789428105.046961:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196adde4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789428105.046971:0:21129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789428105.046977:0:21129:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789428105.046981:0:21129:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff919688453380) has no exports 00000020:00000080:3.0:1789428105.069246:0:21129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789428105.069259:0:21129:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789428105.069265:0:21129:0:(genops.c:885:class_export_put()) final put ffff9196b5b0f800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789428105.069269:0:21129:0:(genops.c:844:class_export_destroy()) destroying export ffff9196b5b0f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789428105.069279:0:21129:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789428105.069407:0:21129:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9196b5b09000 00000020:02000400:3.0:1789428105.070376:0:21129:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789428105.970279:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428106.992646:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789428107.056552:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c098993-d5b4-48be-b0c2-bdb904c28b81->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789428107.056567:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6c098993-d5b4-48be-b0c2-bdb904c28b81->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789428107.056571:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789428107.056575:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789428107.056679:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940173056:0@lo:400:kworker.0 00000400:00000100:3.0:1789428107.056757:0:3615:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940173056 offset 0 length 224: 4 00010000:00010000:3.0:1789428108.016651:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789428108.026976:0:21331:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789428108.052724:0:21331:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789428108.052829:0:21331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428108.052875:0:21331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428108.052883:0:21331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428108.052891:0:21331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428108.052961:0:21331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789428108.052967:0:21331:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789428108.053001:0:21331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789428108.053015:0:21331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91958361ca80 x1876350940172544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789428116 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428108.053045:0:21331:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789428108.053052:0:21331:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789428108.053060:0:21331:0:(import.c:65:import_set_state_nolock()) ffff919583355000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789428108.053065:0:21331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789428108.053069:0:21331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91958361ca80 x1876350940172544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789428116 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428108.053076:0:21331:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789428108.053079:0:21331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00010000:00010000:1.0:1789428108.053307:0:20182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428108.053317:0:20182:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428108.053326:0:20182:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209a00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428108.053330:0:20182:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428108.053341:0:20182:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428108.053349:0:20182:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428108.053355:0:20182:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789428108.053357:0:20182:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789428108.053360:0:20182:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789428108.053378:0:20182:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff919584424000 00010000:00010000:1.0:1789428108.053382:0:20182:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428108.053389:0:20182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede5197d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede5197de expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428108.053400:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428108.053403:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428108.053404:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428108.053548:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940172544:0@lo:38:kworker.0 00000100:00080000:0.0:1789428108.055289:0:21331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789428108.055305:0:21331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91958361c000 x1876350940172672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428112 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428108.055391:0:21331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9196bfa81500 x1876350940172928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428117 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428108.059264:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940172928:0@lo:400:kworker.0 00000100:00100000:0.0:1789428108.059357:0:21331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9196bfa80380 x1876350940173056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428123 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428108.059385:0:21331:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1789428108.059476:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940173056:0@lo:400:kworker.0 00000100:00100000:2.0:1789428108.059742:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940172672:0@lo:400:kworker.0 00000100:00080000:3.0:1789428108.059821:0:21331:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789428108.059857:0:21331:0:(import.c:65:import_set_state_nolock()) ffff919583353000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789428108.060184:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3612:1876350940173184:0@lo:39:umount.0 00000400:00000100:0.0:1789428108.060238:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876350940173184 offset 0 length 224: 4 00010000:00010000:0.0:1789428109.041052:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428110.065495:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428111.097199:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428112.112792:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789428112.176595:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c098993-d5b4-48be-b0c2-bdb904c28b81->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789428112.176611:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) 6c098993-d5b4-48be-b0c2-bdb904c28b81->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789428113.136631:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428114.167388:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428115.186459:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428116.208557:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428116.272883:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428101/real 1789428101] req@ffff9196bfa83b80 x1876350940172800/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789428116 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428116.272915:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9196bfa83b80 x1876350940172800/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789428116 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789428116.272933:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919584424000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789428116.272943:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1789428116.272946:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c098993-d5b4-48be-b0c2-bdb904c28b81:3612:1876350940172800:0@lo:250:kworker.0 00000100:00080000:2.0:1789428116.273945:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) 6c098993-d5b4-48be-b0c2-bdb904c28b81->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789428116.273961:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789428116.273964:0:469:0:(import.c:65:import_set_state_nolock()) ffff919584424000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428116.273969:0:469:0:(import.c:545:import_select_connection()) MGC192.168.202.124@tcp: connect to NID 0@lo last attempt 446 00000100:00080000:2.0:1789428116.273974:0:469:0:(import.c:630:import_select_connection()) MGC192.168.202.124@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789428116.273986:0:469:0:(import.c:666:import_select_connection()) MGC192.168.202.124@tcp: import ffff919584424000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428116.274023:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958444c700 x1876350940173312/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789428116.274129:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c098993-d5b4-48be-b0c2-bdb904c28b81:3612:1876350940173312:0@lo:250:kworker.0 00000400:00000100:0.0:1789428116.274188:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876350940173312 offset 0 length 520: 4 00010000:00010000:1.0:1789428117.232753:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428118.256658:0:17147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428118.321170:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428108/real 1789428108] req@ffff9196bfa80700 x1876350940173184/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789428118 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428118.321326:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9196bfa80700 x1876350940173184/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789428118 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789428118.321346:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919583353000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789428118.321371:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3612:1876350940173184:0@lo:39:umount.0 00000100:00080000:3.0:1789428118.321498:0:21331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789428118.321503:0:21331:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789428118.321508:0:21331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789428118.322761:0:21331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428118.322777:0:21331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428118.322785:0:21331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428118.322792:0:21331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428118.323293:0:21331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428118.323303:0:21331:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428118.323310:0:21331:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428118.323316:0:21331:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428118.323323:0:21331:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428118.327080:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789428118.327097:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428118.327111:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209800 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428118.327115:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428118.327126:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428118.327133:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428118.327139:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789428118.327141:0:17148:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1789428118.327157:0:17148:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff919584424000 00010000:00010000:1.0:1789428118.327161:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428118.327167:0:17148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209800/0x84fc867ede5197ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede5197b4 expref: -99 pid: 19475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428118.327202:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428118.327206:0:17148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428118.327225:0:17148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429c00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428118.327228:0:17148:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428118.327255:0:17148:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428118.327261:0:17148:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428118.327267:0:17148:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789428118.327269:0:17148:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789428118.327274:0:17148:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff919584424000 00010000:00010000:1.0:1789428118.327277:0:17148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428118.327284:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428118.327286:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428118.327288:0:17148:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428118.328143:0:21331:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789428118.328152:0:21331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583429c00/0x84fc867ede5199a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede5199ac expref: -99 pid: 17156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428118.328170:0:21331:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789428118.328331:0:21331:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1789428118.328334:0:21331:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789428118.328367:0:21331:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789428118.328370:0:21331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789428118.328379:0:21331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789428118.328384:0:21331:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789428118.328389:0:21331:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9195830299c0) has no exports 00000020:00080000:3.0:1789428118.328436:0:21331:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff9195830299c0) has no exports 00000020:01000000:3.0:1789428118.330813:0:21331:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9195810e23c0 - data ffff9196a9f99d80/ffff9196bbbb5c00 00000020:01000000:3.0:1789428118.330963:0:21331:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9195810e2f00 - data ffff9196a9d31ca8/ffff9196b5b5fc00 00010000:00010000:1.0:1789428118.331671:0:20182:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1789428118.347960:0:21331:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789428118.357208:0:21331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5197c2 00000020:00000080:3.0:1789428118.357220:0:21331:0:(genops.c:885:class_export_put()) final put ffff9196bbb8b800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1789428118.357248:0:21331:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919583041800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1789428118.357253:0:21331:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919583041800 2 00000020:01000004:3.0:1789428118.357257:0:21331:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff919583041800 from lustre-OST0001 00000020:00000080:3.0:1789428118.357289:0:21331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789428118.357300:0:21331:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1789428118.357305:0:21331:0:(genops.c:885:class_export_put()) final put ffff9196bbb8b000/lustre-OST0001_UUID 00000020:00000080:3.0:1789428118.357308:0:21331:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bbb8b000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1789428118.357314:0:21331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1789428118.357442:0:21331:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 6c098993-d5b4-48be-b0c2-bdb904c28b81->MGS 00010000:00010000:3.0:1789428118.357459:0:21331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff91958375d800/0x84fc867ede51950d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede519514 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789428118.357471:0:21331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff91958375d800/0x84fc867ede51950d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede519514 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428118.357488:0:21331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1789428118.357491:0:21331:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1789428118.357494:0:21331:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1789428118.357508:0:21331:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff919584424000 00010000:00010000:3.0:1789428118.357512:0:21331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff91958375d800/0x84fc867ede51950d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede519514 expref: -99 pid: 17890 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428118.357529:0:21331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789428118.357536:0:21331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428118.357541:0:21331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789428118.357544:0:21331:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1789428118.357546:0:21331:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1789428118.357555:0:21331:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff919584424000 00010000:00010000:3.0:1789428118.357558:0:21331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583f47600/0x84fc867ede5193fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x84fc867ede519403 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789428118.357574:0:21331:0:(import.c:65:import_set_state_nolock()) ffff919584424000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1789428118.357578:0:21331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789428118.357580:0:21331:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789428118.357581:0:21331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789428118.357585:0:21331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789428118.357595:0:21331:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91958444c700 x1876350940173312/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789428136 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789428118.357612:0:21331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789428118.357615:0:21331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000020:00000080:1.0:1789428118.357735:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bbb8b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1789428118.359766:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6c098993-d5b4-48be-b0c2-bdb904c28b81:3612:1876350940173312:0@lo:250:kworker.0 10000000:01000000:3.0:1789428118.359917:0:21331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789428118.359948:0:21331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5193e7 00000020:00000080:3.0:1789428118.359956:0:21331:0:(genops.c:885:class_export_put()) final put ffff9196adaef800/6c098993-d5b4-48be-b0c2-bdb904c28b81 00000020:01000000:3.0:1789428118.359975:0:21331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.124@tcp (flags='') 00000020:00000080:3.0:1789428118.359981:0:21331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789428118.359987:0:21331:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.124@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789428118.359991:0:21331:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff91958302b380) has no exports 00000020:00000080:1.0:1789428118.360818:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196adaef800/6c098993-d5b4-48be-b0c2-bdb904c28b81 for MGC192.168.202.124@tcp 10000000:01000000:0.0:1789428118.362191:0:17156:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789428118.362302:0:21331:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.124@tcp: client import never connected 00000100:00080000:3.0:1789428118.362308:0:21331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789428118.362313:0:21331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789428118.362316:0:21331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789428118.362319:0:21331:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789428118.362386:0:21331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789428118.362394:0:21331:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.124@tcp (uuid 6c098993-d5b4-48be-b0c2-bdb904c28b81) 00000020:01000000:3.0:1789428118.362402:0:21331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789428118.362410:0:21331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789428118.362438:0:21331:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789428118.362445:0:21331:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff919583354000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789428118.362451:0:21331:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff9195845599c0) has exports, disconnecting them 00000020:00080000:3.0:1789428118.362455:0:21331:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff919583354000), last request at 1789428050 00000020:00000080:3.0:1789428118.362460:0:21331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5197ec 00000020:00080000:3.0:1789428118.362472:0:21331:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff919583354000): rc 0 00000020:00000080:3.0:1789428118.362476:0:21331:0:(genops.c:885:class_export_put()) final put ffff919583354000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789428118.363292:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919584424000 for MGC192.168.202.124@tcp 00000020:00000080:1.0:1789428118.363301:0:37:0:(genops.c:885:class_export_put()) final put ffff919584420800/6c098993-d5b4-48be-b0c2-bdb904c28b81 00000020:00000080:1.0:1789428118.363303:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff919584420800/6c098993-d5b4-48be-b0c2-bdb904c28b81 for MGC192.168.202.124@tcp 00000020:01000000:1.0:1789428118.363309:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.124@tcp (6c098993-d5b4-48be-b0c2-bdb904c28b81) 00000020:00000080:1.0:1789428118.363688:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff919583354000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1789428118.370216:0:21331:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789428118.370227:0:21331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789428118.370231:0:21331:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789428118.370240:0:21331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789428118.370288:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583355000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789428118.370489:0:21331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789428118.370499:0:21331:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789428118.370505:0:21331:0:(genops.c:885:class_export_put()) final put ffff919583356000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789428118.370509:0:21331:0:(genops.c:844:class_export_destroy()) destroying export ffff919583356000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789428118.370516:0:21331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:1.0:1789428118.370580:0:21331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789428118.370584:0:21331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789428118.370589:0:21331:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789428118.370597:0:21331:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff919583357000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789428118.370603:0:21331:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff91958455b380) has exports, disconnecting them 00000020:00080000:1.0:1789428118.370607:0:21331:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff919583357000), last request at 1789428050 00000020:00000080:1.0:1789428118.370612:0:21331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede519801 00000020:00080000:1.0:1789428118.370624:0:21331:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff919583357000): rc 0 00000020:00000080:1.0:1789428118.370629:0:21331:0:(genops.c:885:class_export_put()) final put ffff919583357000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789428118.370659:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff919583357000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1789428118.376110:0:21331:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789428118.376121:0:21331:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789428118.376127:0:21331:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789428118.376136:0:21331:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789428118.376208:0:17147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789428118.376448:0:17148:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:1.0:1789428118.376513:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff919583353000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1789428118.377474:0:20182:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789428118.381549:0:17143:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff919584479000:17143] 1 exiting: rc = 0 00000100:00100000:0.0:1789428118.381656:0:17142:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff919584478000:17142] 0 exiting: rc = 1 00000100:00100000:0.0:1789428118.381728:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.382023:0:17146:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9196a0a74800:17146] 2 exiting: rc = 0 00000100:00100000:0.0:1789428118.382088:0:20183:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9196bbb6da00:20183] 3 exiting: rc = 0 00000100:00100000:1.0:1789428118.383339:0:17144:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff919584478c00:17144] 0 exiting: rc = 1 00000100:00100000:0.0:1789428118.388585:0:17145:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff919584479600:17145] 1 exiting: rc = 0 00000100:00100000:0.0:1789428118.388728:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388737:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388745:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388751:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388757:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388763:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388769:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388775:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388780:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388786:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388792:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388798:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388804:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388809:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388815:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388820:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388825:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388830:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388849:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388854:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388860:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388866:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388871:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388876:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388882:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388887:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388893:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388909:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388915:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388921:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388926:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388944:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388949:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388954:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388961:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388967:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388973:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388978:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388984:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388989:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.388994:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389000:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389007:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389012:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389018:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389023:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389028:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389033:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389039:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389045:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389050:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389055:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389060:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389065:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389071:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389076:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389082:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389089:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389094:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389101:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389106:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389111:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389126:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789428118.389132:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789428118.389820:0:21331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789428118.389830:0:21331:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1789428118.389837:0:21331:0:(genops.c:885:class_export_put()) final put ffff919583350000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1789428118.389841:0:21331:0:(genops.c:844:class_export_destroy()) destroying export ffff919583350000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1789428118.389847:0:21331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1789428118.389899:0:21331:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919583041800 1 00000020:00000080:0.0:1789428118.389905:0:21331:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x84fc867ede5197a6 00000020:00000080:0.0:1789428118.389912:0:21331:0:(genops.c:885:class_export_put()) final put ffff9196bbb8a800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1789428118.389942:0:21331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1789428118.389946:0:21331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789428118.389951:0:21331:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789428118.389955:0:21331:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff9196bbde19c0) has no exports 00000020:00000080:0.0:1789428118.394635:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9196bbb8a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789428118.453845:0:21331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789428118.453856:0:21331:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789428118.453862:0:21331:0:(genops.c:885:class_export_put()) final put ffff919583041000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789428118.453865:0:21331:0:(genops.c:844:class_export_destroy()) destroying export ffff919583041000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789428118.453876:0:21331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789428118.454185:0:21331:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff919583047000 00000020:01000000:2.0:1789428118.454203:0:21331:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789428118.454207:0:21331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789428118.454210:0:21331:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789428118.454213:0:21331:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff9196bbde4d40) has no exports 00000020:00000080:2.0:1789428118.454237:0:21331:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789428118.454240:0:21331:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789428118.454242:0:21331:0:(genops.c:885:class_export_put()) final put ffff9196adde2800/OSS_uuid 00000020:00000080:2.0:1789428118.454243:0:21331:0:(genops.c:844:class_export_destroy()) destroying export ffff9196adde2800/OSS_uuid for OSS 00000020:01000000:2.0:1789428118.454246:0:21331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1789428118.454326:0:18663:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff919581dc3400:18663] 0 exiting: rc = 1 00000100:00100000:3.0:1789428118.454328:0:18664:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff919581d68200:18664] 1 exiting: rc = 0 00000100:00080000:0.0:1789428118.454434:0:17155:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789428118.454513:0:18665:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff91968520a400:18665] 2 exiting: rc = 0 00000100:00100000:1.0:1789428118.454781:0:18820:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9196b5936200:18820] 3 exiting: rc = 0 00000100:00100000:3.0:1789428118.454846:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.454864:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.454872:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.454877:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.454883:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.454891:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.454898:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.454913:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.454919:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.454944:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.454951:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.454956:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455067:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455075:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455080:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455085:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455090:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455096:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455101:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455107:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455113:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455118:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455124:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455131:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455137:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455143:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455149:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455154:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455160:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455165:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455171:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455175:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455180:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455185:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455190:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455195:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455200:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455206:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455212:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455217:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455222:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455228:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455241:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455246:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455252:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455257:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455261:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455267:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455272:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455277:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455283:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455288:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455293:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455298:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455303:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455308:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455314:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455319:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455324:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455330:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455339:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455346:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455352:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.455357:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789428118.456487:0:18667:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff91968520a800:18667] 0 exiting: rc = 1 00000100:00100000:0.0:1789428118.456487:0:18668:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9196b5935600:18668] 1 exiting: rc = 0 00000100:00100000:3.0:1789428118.456642:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456651:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456661:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456669:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456678:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456683:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456688:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456693:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456698:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456703:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456708:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456713:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456719:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456735:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456740:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456748:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456753:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456759:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456768:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456777:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456784:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456789:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456795:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456800:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456805:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456810:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456822:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456830:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456836:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456841:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456847:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456852:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456858:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456865:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456870:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456876:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456883:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456888:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456893:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456899:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456904:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456909:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.456914:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457145:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457166:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457173:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457178:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457182:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457194:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457198:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457203:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457209:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457215:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457220:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457226:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457232:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457237:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457242:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457246:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457251:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457256:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457262:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457268:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.457274:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789428118.461647:0:20297:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_003: service thread [ffff919584504200:20297] 3 exiting: rc = 0 00000100:00100000:2.0:1789428118.461694:0:18669:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9196b5934200:18669] 0 exiting: rc = 1 00000100:00100000:3.0:1789428118.461747:0:18670:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9196b5936400:18670] 1 exiting: rc = 0 00000100:00100000:0.0:1789428118.462004:0:18671:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9196b5936e00:18671] 2 exiting: rc = 0 00000100:00100000:3.0:1789428118.462200:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462207:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462213:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462219:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462225:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462231:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462244:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462250:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462256:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462262:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462267:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462273:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462279:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462284:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462291:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462296:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462302:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462308:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462329:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462334:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462340:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462351:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462358:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462363:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462368:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462373:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462379:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462384:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462389:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462395:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462412:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462453:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462458:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462464:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462474:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462481:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462488:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462505:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462513:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462519:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462597:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462608:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462614:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462621:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462629:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462636:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462642:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462647:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462773:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462782:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462787:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462793:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462798:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462812:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462818:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462825:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462832:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462845:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462859:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462867:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462878:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462886:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462897:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.462917:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789428118.473623:0:18672:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9196b5937600:18672] 0 exiting: rc = 1 00000100:00100000:2.0:1789428118.473665:0:18673:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9196b5936c00:18673] 1 exiting: rc = 0 00000100:00100000:3.0:1789428118.473771:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473779:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473785:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473790:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473796:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473801:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473807:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473812:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473817:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473822:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473826:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473832:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473838:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473843:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473848:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473853:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473859:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473865:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473870:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473875:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473879:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473884:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473888:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473893:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473911:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473916:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473921:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473926:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473941:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473946:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473950:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473955:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473968:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473974:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473980:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473984:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473989:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473994:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.473999:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474003:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474008:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474012:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474016:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474020:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474025:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474029:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474034:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474038:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474042:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474047:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474051:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474061:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474066:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474070:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474075:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474079:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474084:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474089:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474093:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474105:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474111:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474117:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474122:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789428118.474127:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.475359:0:18675:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9196b5936a00:18675] 1 exiting: rc = 0 00000100:00100000:1.0:1789428118.475576:0:18674:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9196b5937400:18674] 0 exiting: rc = 1 00000100:00100000:2.0:1789428118.476640:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476655:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476673:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476681:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476688:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476694:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476700:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476739:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476746:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476751:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476757:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476773:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476780:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476786:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476792:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476799:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476805:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476812:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476819:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476840:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476847:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476853:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476859:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476865:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476872:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476888:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476894:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476901:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476907:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476913:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476920:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476953:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476960:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476968:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.476979:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477787:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477797:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477806:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477818:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477829:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477841:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477855:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477867:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477899:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477908:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477914:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477920:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477936:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477943:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477949:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477956:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477962:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477968:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477974:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.477980:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.478071:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.478079:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.478084:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.478090:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.478096:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.478111:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.478116:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.478123:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789428118.478136:0:21331:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789428118.490560:0:21331:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1789428133.782393:0:22096:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789428142.399299:0:22695:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789428142.399305:0:22695:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1789428142.399307:0:22695:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789428142.399611:0:22695:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9196bbbf1000 00000020:01000004:1.0:1789428142.399627:0:22695:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789428142.399640:0:22695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789428142.399653:0:22695:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff91958302b380) 00000020:00000080:1.0:1789428142.399668:0:22695:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789428142.464230:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789428142.467585:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789428142.476409:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789428142.481637:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789428142.483216:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1789428142.483670:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1789428142.484654:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789428142.485311:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789428142.485784:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789428142.486311:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1789428142.486807:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789428142.487301:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789428142.487614:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789428142.487977:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789428142.488386:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789428142.490373:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789428142.491661:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789428142.492409:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789428142.492868:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789428142.493300:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789428142.493596:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1789428142.493958:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1789428142.494361:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789428142.494900:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789428142.495231:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1789428142.495554:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789428142.495881:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1789428142.496071:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1789428142.496691:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1789428142.497059:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1789428142.497589:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789428142.497977:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789428142.498321:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1789428142.499029:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789428142.499458:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1789428142.499906:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1789428142.500287:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789428142.500781:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789428142.501044:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1789428142.501411:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789428142.501918:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1789428142.502283:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789428142.502631:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1789428142.503019:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789428142.503369:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789428142.503893:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789428142.504340:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789428142.506788:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1789428142.507361:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1789428142.507826:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1789428142.508660:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1789428142.509407:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1789428142.510048:0:22695:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:3.0:1789428142.511474:0:22695:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789428142.511738:0:22695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789428142.511748:0:22695:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789428142.511762:0:22695:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede519c5a 00000020:01000004:3.0:1789428142.511770:0:22695:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789428142.511776:0:22695:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789428142.511781:0:22695:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9196bbbf1000 from MGS 00000020:01000004:3.0:1789428142.511785:0:22695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789428142.511796:0:22695:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff919584558000) 00000020:00000080:3.0:1789428142.511807:0:22695:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789428142.511882:0:22695:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bbbf1000 from MGS, refs=2 00080000:01000000:3.0:1789428142.511887:0:22695:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789428142.511892:0:22695:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede519c68 00000100:00100000:3.0:1789428142.511996:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789428142.512125:0:22695:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789428142.512132:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789428142.513645:0:22695:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789428142.513860:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1789428142.515064:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789428142.515386:0:22695:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1789428142.515393:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789428142.516352:0:22695:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789428142.516360:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789428142.517671:0:22695:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789428142.517752:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789428142.518859:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428142.518865:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428142.518866:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428142.519253:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428142.519255:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428142.519257:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428142.520069:0:22695:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789428142.522854:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789428142.528615:0:22695:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789428142.529735:0:22707:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789428142.529795:0:22695:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789428142.529834:0:22695:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789428142.531339:0:22695:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789428142.531945:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428142.535945:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789428142.535954:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789428142.542961:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789428142.542974:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789428142.543332:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789428142.543338:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789428142.544368:0:22695:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789428142.544389:0:22695:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.124@tcp' 00000020:01000004:2.0:1789428142.544391:0:22695:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:3.0:1789428142.544550:0:22712:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:2.0:1789428142.544692:0:22695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.124@tcp (typ=mgc) 00000020:00000080:2.0:1789428142.544733:0:22695:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.124@tcp (ffff919688450000) 00000020:00000080:2.0:1789428142.544750:0:22695:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789428142.544957:0:22695:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919683dff800@MGC192.168.202.124@tcp: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1789428142.545123:0:22695:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.124@tcp-0 is initialized 00000040:01000000:2.0:1789428142.545130:0:22695:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789428142.546562:0:22713:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789428142.546650:0:22695:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.124@tcp (uuid e871a47a-d8aa-4c92-86ef-047b0047c703) 00000020:00000080:2.0:1789428142.546671:0:22695:0:(genops.c:1384:class_connect()) connect: client e871a47a-d8aa-4c92-86ef-047b0047c703, cookie 0x84fc867ede519c76 00000100:00080000:2.0:1789428142.546755:0:22695:0:(import.c:545:import_select_connection()) MGC192.168.202.124@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789428142.546837:0:22695:0:(import.c:666:import_select_connection()) MGC192.168.202.124@tcp: import ffff919683dff800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428142.546876:0:22695:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958444ea00 x1876350940173440/t0(0) o250->MGC192.168.202.124@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789428142.546956:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e871a47a-d8aa-4c92-86ef-047b0047c703:3612:1876350940173440:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789428142.547026:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789428142.547092:0:22695:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e871a47a-d8aa-4c92-86ef-047b0047c703->MGS 00000020:01000004:2.0:1789428142.547112:0:22695:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789428142.547137:0:22695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789428142.547152:0:22695:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff919688453380) 00000020:00000080:2.0:1789428142.547164:0:22695:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789428142.555902:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940173440 00000100:00100000:0.0:1789428142.555917:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940173440 00000100:00100000:0.0:1789428142.555957:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789428142.555965:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968290ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3612:x1876350940173440:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789428142.555993:0:22709:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e871a47a-d8aa-4c92-86ef-047b0047c703@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1789428142.556023:0:22709:0:(genops.c:1384:class_connect()) connect: client e871a47a-d8aa-4c92-86ef-047b0047c703, cookie 0x84fc867ede519c84 00000100:00080000:0.0:1789428142.556167:0:22709:0:(import.c:65:import_set_state_nolock()) ffff919584453800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789428142.556253:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968290ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+5:3612:x1876350940173440:12345-0@lo:250:mount.lustre.0 Request processed in 288us (9226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428142.556261:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789428142.556318:0:3612:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.124@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789428142.556328:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.202.124@tcp: connect to target with instance 0 00000100:00080000:0.0:1789428142.556336:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.202.124@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789428142.556341:0:3612:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789428142.556345:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919683dff800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789428142.556347:0:3612:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789428142.556365:0:3612:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789428142.556372:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e871a47a-d8aa-4c92-86ef-047b0047c703:3612:1876350940173440:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789428142.573190:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428142.573391:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789428142.573398:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789428142.579453:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789428142.579474:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789428142.580108:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789428142.580116:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789428142.581261:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428142.581453:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789428142.581458:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789428142.582062:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789428142.582068:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789428142.612669:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789428142.612969:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789428142.612976:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789428142.615163:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789428142.615177:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789428142.616166:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789428142.616321:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789428142.616326:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789428142.617108:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789428142.617116:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789428142.617896:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428142.618052:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789428142.618059:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789428142.622030:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789428142.622047:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789428142.622891:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428142.623057:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789428142.623063:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789428142.623718:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789428142.623726:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789428142.652973:0:22695:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789428142.653186:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789428142.653192:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789428142.658937:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789428142.658954:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789428142.662852:0:22695:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789428142.662872:0:22695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789428142.664987:0:22695:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789428142.665017:0:22695:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789428142.665024:0:22695:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789428142.665131:0:22695:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789428142.665164:0:22695:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.124@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789428142.665169:0:22695:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789428142.665171:0:22695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789428142.665172:0:22695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428142.665174:0:22695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428142.665175:0:22695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428142.665176:0:22695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428142.665178:0:22695:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789428142.665180:0:22695:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789428142.665182:0:22695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428142.665184:0:22695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789428142.665186:0:22695:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789428142.665188:0:22695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789428142.665190:0:22695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789428142.665191:0:22695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428142.665192:0:22695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428142.665193:0:22695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428142.665194:0:22695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428142.665195:0:22695:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789428142.665196:0:22695:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789428142.665202:0:22695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428142.665202:0:22695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789428142.665228:0:22695:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789428142.665246:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940173568:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789428142.665315:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428142.665356:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682bc7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789428142.665508:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940173568 00000100:00100000:2.0:1789428142.665517:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940173568 00000100:00100000:2.0:1789428142.665549:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428142.665557:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968290e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+5:22695:x1876350940173568:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789428142.665611:0:22711:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789428142.665614:0:22711:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789428142.665617:0:22711:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789428142.666082:0:22732:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789428142.666481:0:22711:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1789428142.668323:0:22733:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789428142.668329:0:22733:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1789428142.668331:0:22733:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789428142.668334:0:22733:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789428142.668583:0:22733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:2.0:1789428142.676089:0:22711:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789428142.676103:0:22711:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789428142.682324:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968290e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+5:22695:x1876350940173568:12345-0@lo:253:mount.lustre.0 Request processed in 16757us (16999us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428142.682344:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789428142.682610:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940173568:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789428142.682627:0:22695:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789428142.682630:0:22695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789428142.682632:0:22695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789428142.682634:0:22695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428142.682635:0:22695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428142.682636:0:22695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428142.682637:0:22695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428142.682638:0:22695:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789428142.682639:0:22695:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789428142.682641:0:22695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428142.682655:0:22695:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789428142.682679:0:22695:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9196bbbf1000 from lustre-MDT0000 10000000:01000000:0.0:1789428142.682722:0:22695:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789428142.682726:0:22695:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789428142.682730:0:22695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff919688450000 10000000:01000000:0.0:1789428142.682738:0:22695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789428142.682747:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff919688450000 from 1 10000000:01000000:0.0:1789428142.682749:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789428142.682799:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.682810:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.682820:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428142.682856:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940173696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789428142.682893:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428142.682932:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682bc7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789428142.683081:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940173696 00000100:00100000:1.0:1789428142.683088:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940173696 00000100:00100000:1.0:1789428142.683128:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789428142.683137:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+5:22695:x1876350940173696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428142.683149:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428142.683164:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1ee00/0x84fc867ede519c92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519c8b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428142.683185:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1ee00/0x84fc867ede519c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519c8b expref: 6 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428142.683196:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1ee00/0x84fc867ede519c92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519c8b expref: 6 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428142.683213:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1ee00, rc 0) 00000100:00100000:1.0:1789428142.683254:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+6:22695:x1876350940173696:12345-0@lo:101:mount.lustre.0 Request processed in 118us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428142.683260:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789428142.683339:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940173696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428142.683351:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519c92 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428142.683360:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519c92 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428142.683447:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940173824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428142.683476:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428142.683488:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698419540 going to sleep for 11 seconds 00000100:00100000:1.0:1789428142.683538:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940173824 00000100:00100000:1.0:1789428142.683543:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940173824 00000100:00100000:1.0:1789428142.683573:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789428142.683579:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+6:22695:x1876350940173824:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428142.683658:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+6:22695:x1876350940173824:12345-0@lo:501:mount.lustre.0 Request processed in 78us (181us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789428142.683665:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789428142.683777:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940173824:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789428142.683805:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789428142.683824:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519c92 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428142.683832:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519c92 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428142.683852:0:22695:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9196bbbf1000 10000000:01000000:3.0:1789428142.683856:0:22695:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789428142.683860:0:22695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9196bbbf1000 10000000:01000000:3.0:1789428142.683862:0:22695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789428142.683865:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9196bbbf1000 from 1 10000000:01000000:3.0:1789428142.683867:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789428142.683884:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede519c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428142.683892:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede519c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428142.683899:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede519c99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428142.683911:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940173952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789428142.683942:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428142.683969:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698419540 going to sleep for 11 seconds 00000100:00100000:2.0:1789428142.684162:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940173952 00000100:00100000:2.0:1789428142.684166:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940173952 00000100:00100000:2.0:1789428142.684203:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428142.684211:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+6:22695:x1876350940173952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428142.684219:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428142.684230:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428000/0x84fc867ede519ca0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519c99 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.684246:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428000/0x84fc867ede519ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519c99 expref: 7 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.684255:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428000/0x84fc867ede519ca0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519c99 expref: 7 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.684262:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428000, rc 0) 00000100:00100000:2.0:1789428142.684302:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+7:22695:x1876350940173952:12345-0@lo:101:mount.lustre.0 Request processed in 92us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428142.684307:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789428142.684809:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940173952:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428142.684828:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede519c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519ca0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428142.684837:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede519c99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519ca0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428142.684850:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789428142.684904:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede519c99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519ca0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428142.684922:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196c21e9200/0x84fc867ede519c99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519ca0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428142.684928:0:22695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789428142.684932:0:22695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789428142.684936:0:22695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9196bbbf1000 10000000:01000000:3.0:1789428142.684939:0:22695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789428142.684943:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789428142.684945:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789428142.684963:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196c21e8e00/0x84fc867ede519ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428142.684970:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196c21e8e00/0x84fc867ede519ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428142.684977:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196c21e8e00/0x84fc867ede519ca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428142.684990:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940174080:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789428142.685021:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428142.685053:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698419540 going to sleep for 11 seconds 00000100:00100000:2.0:1789428142.685097:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940174080 00000100:00100000:2.0:1789428142.685102:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940174080 00000100:00100000:2.0:1789428142.685146:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789428142.685154:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+7:22695:x1876350940174080:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428142.685162:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428142.685172:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428e00/0x84fc867ede519cae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519ca7 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.685187:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428e00/0x84fc867ede519cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519ca7 expref: 8 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.685195:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428e00/0x84fc867ede519cae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519ca7 expref: 8 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.685202:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428e00, rc 0) 00000100:00100000:2.0:1789428142.685248:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+8:22695:x1876350940174080:12345-0@lo:101:mount.lustre.0 Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428142.685254:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789428142.685409:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940174080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428142.685459:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196c21e8e00/0x84fc867ede519ca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519cae expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.685467:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196c21e8e00/0x84fc867ede519ca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519cae expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428142.685537:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940174208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428142.685563:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428142.685575:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682bc7300 going to sleep for 11 seconds 00000100:00100000:3.0:1789428142.685690:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940174208 00000100:00100000:3.0:1789428142.685695:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940174208 00000100:00100000:3.0:1789428142.685739:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789428142.685747:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+8:22695:x1876350940174208:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428142.686007:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+9:22695:x1876350940174208:12345-0@lo:501:mount.lustre.0 Request processed in 261us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428142.686023:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789428142.686101:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940174208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428142.686130:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940174336:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428142.686170:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428142.686199:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff919682bc7300 going to sleep for 11 seconds 00000100:00100000:3.0:1789428142.686247:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940174336 00000100:00100000:3.0:1789428142.686252:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940174336 00000100:00100000:3.0:1789428142.686282:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789428142.686290:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+9:22695:x1876350940174336:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428142.687100:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+9:22695:x1876350940174336:12345-0@lo:503:mount.lustre.0 Request processed in 808us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428142.687108:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789428142.687194:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940174336:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789428142.688029:0:22734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22734:1876350940174464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789428142.688078:0:22734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428142.688142:0:22734:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196985a2240 going to sleep for 11 seconds 00000100:00100000:0.0:1789428142.688175:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940174464 00000100:00100000:0.0:1789428142.688181:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940174464 00000100:00100000:0.0:1789428142.688256:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789428142.688265:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+9:22734:x1876350940174464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789428142.689038:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+9:22734:x1876350940174464:12345-0@lo:502:llog_process_th.0 Request processed in 772us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428142.689057:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789428142.689132:0:22734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22734:1876350940174464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789428142.689156:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428142.689167:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428142.689169:0:22734:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789428142.689174:0:22734:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789428142.689177:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789428142.689190:0:22734:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff919688454d40) 00000020:00000080:2.0:1789428142.689204:0:22734:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789428142.689210:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789428142.689300:0:22734:0:(osd_handler.c:8926:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789428142.689310:0:22734:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede519cbc 00000020:00000080:2.0:1789428142.689564:0:22734:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789428142.689569:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428142.689573:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428142.689575:0:22734:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789428142.689577:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428142.689581:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428142.689582:0:22734:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789428142.689585:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789428142.689593:0:22734:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9196884519c0) 00000020:00000080:2.0:1789428142.689602:0:22734:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789428142.689605:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789428142.689607:0:22734:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789428142.689610:0:22734:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789428142.689616:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789428142.689663:0:22734:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bbbf1000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789428142.689677:0:22734:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff919581ddcd40) 00000020:00000080:2.0:1789428142.689685:0:22734:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789428142.689744:0:22734:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789428142.689750:0:22734:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede519cd1 00000020:00000080:2.0:1789428142.689893:0:22734:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789428142.689901:0:22734:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789428142.689904:0:22734:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x84fc867ede519cd8 00080000:01000000:2.0:1789428142.689909:0:22734:0:(osd_handler.c:8926:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789428142.689912:0:22734:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede519cdf 00010000:00010000:0.0:1789428142.763691:0:22734:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1789428142.764696:0:22734:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:0.0:1789428142.765082:0:22734:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789428142.765812:0:22734:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff919688893380) 00000020:00000080:0.0:1789428142.765832:0:22734:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789428142.765914:0:22734:0:(osd_handler.c:8926:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789428142.765923:0:22734:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede519ced 00000020:00000080:0.0:1789428142.767480:0:22734:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789428142.781404:0:22734:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x84fc867ede519cf4 00000020:00000080:3.0:1789428142.783645:0:22734:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789428142.783658:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428142.783664:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428142.783667:0:22734:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789428142.783669:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789428142.783671:0:22734:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1789428142.783673:0:22734:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789428142.783674:0:22734:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789428142.783676:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789428142.783679:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428142.783680:0:22734:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789428142.783683:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428142.783687:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428142.783689:0:22734:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789428142.783693:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789428142.783752:0:22734:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789428142.783767:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428142.783769:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428142.783770:0:22734:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789428142.783772:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428142.783774:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428142.783775:0:22734:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789428142.783781:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789428142.783786:0:22734:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:00000080:3.0:1789428142.783807:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789428142.783817:0:22734:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff91958455cd40) 00000020:00000080:3.0:1789428142.783829:0:22734:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789428142.783832:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789428142.783883:0:22734:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789428142.783887:0:22734:0:(osd_handler.c:8926:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789428142.783892:0:22734:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede519d02 00010000:00080000:3.0:1789428142.783927:0:22734:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196bbb8e000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:3.0:1789428142.785326:0:22734:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1789428142.796088:0:22734:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789428142.796105:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789428142.796148:0:22734:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789428142.796170:0:22734:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede519d09 00000100:00080000:3.0:1789428142.796182:0:22734:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789428142.796194:0:22734:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9196bbb8e000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428142.796902:0:22734:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfa81880 x1876350940174592/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789428142.796928:0:22734:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789428142.796981:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940174592:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1789428142.796987:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428142.796992:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428142.796995:0:22734:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1789428142.796998:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789428142.797001:0:22734:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:3.0:1789428142.797003:0:22734:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789428142.797005:0:22734:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789428142.797006:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789428142.797010:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428142.797012:0:22734:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789428142.797016:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789428142.797034:0:22734:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789428142.797038:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428142.797040:0:22734:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789428142.797045:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789428142.797048:0:22734:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000100:00100000:0.0:1789428142.797054:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428142.797095:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940174592 00000100:00100000:3.0:1789428142.797103:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940174592 00000100:00100000:3.0:1789428142.797148:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789428142.797156:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1876350940174592:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789428142.797172:0:22721:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:0.0:1789428142.800499:0:22734:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789428142.800513:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789428142.800532:0:22734:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff919688894d40) 00000020:00000080:0.0:1789428142.800553:0:22734:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789428142.800559:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789428142.800644:0:22734:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789428142.800651:0:22734:0:(osd_handler.c:8926:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789428142.800660:0:22734:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede519d17 00010000:00080000:0.0:1789428142.800692:0:22734:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9195848d7800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:0.0:1789428142.800940:0:22734:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789428142.801877:0:22734:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789428142.802187:0:22734:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789428142.815353:0:22734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789428142.820850:0:22734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1789428142.824434:0:22734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1789428142.825220:0:22740:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789428142.825225:0:22740:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789428142.826201:0:22734:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789428142.826216:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789428142.826253:0:22734:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789428142.826273:0:22734:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede519d1e 00000100:00080000:2.0:1789428142.826283:0:22734:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789428142.826306:0:22734:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9195848d7800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428142.826341:0:22734:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958444c380 x1876350940174720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789428142.826400:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940174720:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789428142.826497:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940174720 offset 0 length 520: 4 00000100:00080000:2.0:1789428142.826734:0:22734:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789428142.826867:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428142.826872:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428142.826874:0:22734:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789428142.826877:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789428142.826880:0:22734:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1789428142.826881:0:22734:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789428142.826883:0:22734:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789428142.826884:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789428142.826887:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428142.826888:0:22734:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789428142.826891:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789428142.826894:0:22734:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789428142.826898:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428142.826899:0:22734:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789428142.826902:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789428142.826905:0:22734:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:2.0:1789428142.826926:0:22734:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789428142.826929:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789428142.826941:0:22734:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff919581dd99c0) 00000020:00000080:2.0:1789428142.826954:0:22734:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1789428142.826959:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789428142.827014:0:22734:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789428142.827019:0:22734:0:(osd_handler.c:8926:osd_obd_connect()) connect #7 00000020:00000080:2.0:1789428142.827024:0:22734:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x84fc867ede519d2c 00010000:00080000:2.0:1789428142.827053:0:22734:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196bca11000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1789428142.827260:0:22734:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1789428142.827325:0:22734:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789428142.827349:0:22734:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:3.0:1789428142.828027:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3612:x1876350940174592:12345-0@lo:38:llog_process_th.0 Request processed in 30863us (30967us total) trans 0 rc -19/-19 00000100:00080000:0.0:1789428142.828038:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbb8e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1789428142.828039:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789428142.828048:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789428142.828053:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940174592:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789428142.829918:0:22734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789428142.830154:0:22734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789428142.830282:0:22734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:3.0:1789428142.836390:0:22742:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789428142.836399:0:22742:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789428142.843732:0:22734:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789428142.843811:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789428142.843892:0:22734:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789428142.843915:0:22734:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede519d33 00000100:00080000:2.0:1789428142.843927:0:22734:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789428142.843941:0:22734:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9196bca11000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428142.843980:0:22734:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958444fb80 x1876350940174848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789428142.844010:0:22734:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789428142.844152:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940174848:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789428142.844329:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940174848 offset 0 length 520: 4 00000020:01000000:2.0:1789428142.848000:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428142.848010:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428142.848013:0:22734:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789428142.848017:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428142.848021:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428142.848023:0:22734:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789428142.848026:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789428142.848029:0:22734:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789428142.848031:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428142.848033:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428142.848034:0:22734:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789428142.848037:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428142.848039:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428142.848040:0:22734:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789428142.848044:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789428142.848092:0:22734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22734:1876350940174976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789428142.848174:0:22734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428142.848228:0:22734:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886de40 going to sleep for 11 seconds 00000100:00100000:1.0:1789428142.848302:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940174976 00000100:00100000:1.0:1789428142.848311:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940174976 00000100:00100000:1.0:1789428142.848363:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428142.848375:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+9:22734:x1876350940174976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789428142.848538:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+9:22734:x1876350940174976:12345-0@lo:502:llog_process_th.0 Request processed in 167us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428142.848546:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789428142.850295:0:22734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22734:1876350940174976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789428142.850336:0:22734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428142.850345:0:22734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428142.850354:0:22734:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789428142.850359:0:22734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789428142.850466:0:22695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1789428142.850494:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789428142.850509:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196c21e8e00/0x84fc867ede519ca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519cae expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.850521:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196c21e8e00/0x84fc867ede519ca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519cae expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428142.850530:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196bbbf1000 from 1 10000000:01000000:0.0:1789428142.850533:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789428142.850567:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.850577:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.850587:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428142.850793:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940175104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789428142.851514:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428142.851559:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687fd4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789428142.851577:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940175104 00000100:00100000:0.0:1789428142.851587:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940175104 00000100:00100000:1.0:1789428142.851946:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428142.851956:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+9:22695:x1876350940175104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428142.851970:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428142.851986:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1e600/0x84fc867ede519d41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519d3a expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428142.852024:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1e600/0x84fc867ede519d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519d3a expref: 10 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428142.852034:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1e600/0x84fc867ede519d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519d3a expref: 10 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428142.852043:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e600, rc 0) 00000100:00100000:1.0:1789428142.852101:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+10:22695:x1876350940175104:12345-0@lo:101:mount.lustre.0 Request processed in 147us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428142.852107:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789428142.852155:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940175104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428142.852170:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519d41 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.852180:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519d41 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428142.852895:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940175232:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789428142.852945:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428142.856022:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687fd4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789428142.857903:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940175232 00000100:00100000:2.0:1789428142.857917:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940175232 00000100:00100000:2.0:1789428142.857978:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789428142.857988:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+10:22695:x1876350940175232:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789428142.858013:0:22709:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789428142.858019:0:22709:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789428142.858146:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+10:22695:x1876350940175232:12345-0@lo:256:mount.lustre.0 Request processed in 159us (5200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428142.858153:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789428142.858264:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940175232:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789428142.859243:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789428142.859272:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519d41 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.859286:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519d41 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428142.859295:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bbbf1000 from 1 10000000:01000000:0.0:1789428142.859298:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789428142.859336:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.859344:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.864833:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428142.864868:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940175360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789428142.864938:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428142.864983:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687fd4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789428142.865052:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940175360 00000100:00100000:3.0:1789428142.865061:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940175360 00000100:00100000:3.0:1789428142.865157:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789428142.865168:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+10:22695:x1876350940175360:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428142.865182:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428142.865201:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196c21e9400/0x84fc867ede519d4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519d48 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428142.865226:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196c21e9400/0x84fc867ede519d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519d48 expref: 11 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428142.865255:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196c21e9400/0x84fc867ede519d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519d48 expref: 11 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428142.865264:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e9400, rc 0) 00000100:00100000:3.0:1789428142.865310:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+11:22695:x1876350940175360:12345-0@lo:101:mount.lustre.0 Request processed in 145us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428142.865317:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789428142.865458:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940175360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428142.865473:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519d4f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.865481:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519d4f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428142.865550:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940175488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428142.865577:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428142.865998:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687fd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789428142.866077:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940175488 00000100:00100000:1.0:1789428142.866084:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940175488 00000100:00100000:1.0:1789428142.866112:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789428142.866119:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+11:22695:x1876350940175488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428142.866255:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+11:22695:x1876350940175488:12345-0@lo:501:mount.lustre.0 Request processed in 136us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428142.866262:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789428142.866350:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940175488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428142.866382:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940175616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428142.866523:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428142.866543:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687fd4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789428142.866602:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940175616 00000100:00100000:1.0:1789428142.866606:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940175616 00000100:00100000:1.0:1789428142.866626:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789428142.866633:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+11:22695:x1876350940175616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789428142.866741:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+11:22695:x1876350940175616:12345-0@lo:503:mount.lustre.0 Request processed in 108us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428142.866748:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789428142.867042:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940175616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428142.870153:0:22744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22744:1876350940175744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789428142.870238:0:22744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428142.870285:0:22744:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b2bea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789428142.870353:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940175744 00000100:00100000:1.0:1789428142.870361:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940175744 00000100:00100000:1.0:1789428142.870405:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789428142.870445:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+11:22744:x1876350940175744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789428142.871068:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+11:22744:x1876350940175744:12345-0@lo:502:llog_process_th.0 Request processed in 652us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428142.871077:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789428142.871200:0:22744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22744:1876350940175744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789428142.871234:0:22744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428142.871244:0:22744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428142.871247:0:22744:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789428142.871254:0:22744:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196bbbf1000 00000020:00000080:0.0:1789428142.871257:0:22744:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428142.871265:0:22744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428142.871267:0:22744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428142.871269:0:22744:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789428142.871272:0:22744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428142.871274:0:22744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428142.871275:0:22744:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789428142.871278:0:22744:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196bbbf1000 00000020:00000080:0.0:1789428142.871280:0:22744:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428142.871340:0:22744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428142.871343:0:22744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428142.871344:0:22744:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789428142.871347:0:22744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428142.871349:0:22744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428142.871350:0:22744:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789428142.871353:0:22744:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196bbbf1000 00000020:00000080:0.0:1789428142.871354:0:22744:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428142.871371:0:22744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428142.871374:0:22744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428142.871375:0:22744:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789428142.871378:0:22744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428142.871381:0:22744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428142.871382:0:22744:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789428142.871385:0:22744:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196bbbf1000 00000020:00000080:0.0:1789428142.871387:0:22744:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789428142.871457:0:22744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22744:1876350940175872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789428142.871495:0:22744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428142.871527:0:22744:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687fd4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789428142.871656:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940175872 00000100:00100000:3.0:1789428142.871663:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940175872 00000100:00100000:3.0:1789428142.875574:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789428142.875592:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+11:22744:x1876350940175872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789428142.876538:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+11:22744:x1876350940175872:12345-0@lo:502:llog_process_th.0 Request processed in 950us (5039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428142.876548:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789428142.876689:0:22744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22744:1876350940175872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789428142.876738:0:22744:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428142.876745:0:22744:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428142.876747:0:22744:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789428142.876751:0:22744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789428142.883998:0:22695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789428142.884038:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789428142.884097:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519d4f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.884111:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519d4f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428142.884167:0:22695:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789428142.884170:0:22695:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9196bbbf1000 10000000:01000000:2.0:1789428142.884173:0:22695:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9196bbbf1000 10000000:01000000:2.0:1789428142.884177:0:22695:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789428142.884182:0:22695:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9196bbbf1000 from 1 10000000:01000000:2.0:1789428142.884185:0:22695:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789428142.884224:0:22695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429e00/0x84fc867ede519d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.884232:0:22695:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583429e00/0x84fc867ede519d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.884254:0:22695:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583429e00/0x84fc867ede519d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428142.884277:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940176000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789428142.884341:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428142.884389:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789428142.886828:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940176000 00000100:00100000:0.0:1789428142.886842:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940176000 00000100:00100000:0.0:1789428142.886896:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789428142.886911:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+11:22695:x1876350940176000:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428142.886928:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428142.886949:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685209e00/0x84fc867ede519d5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519d56 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.886976:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685209e00/0x84fc867ede519d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519d56 expref: 12 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.886987:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685209e00/0x84fc867ede519d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519d56 expref: 12 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428142.886996:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685209e00, rc 0) 00000100:00100000:0.0:1789428142.887063:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22695:x1876350940176000:12345-0@lo:101:mount.lustre.0 Request processed in 159us (2722us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428142.887069:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789428142.891472:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940176000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428142.891503:0:22695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583429e00/0x84fc867ede519d56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519d5d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.891516:0:22695:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583429e00/0x84fc867ede519d56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519d5d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428142.891600:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940176128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428142.891670:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428142.891722:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789428142.891745:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940176128 00000100:00100000:2.0:1789428142.891751:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940176128 00000100:00100000:2.0:1789428142.891994:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789428142.892003:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22695:x1876350940176128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428142.892134:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22695:x1876350940176128:12345-0@lo:501:mount.lustre.0 Request processed in 132us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428142.892141:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789428142.892180:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940176128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428142.892207:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940176256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789428142.892254:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428142.892277:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789428142.892290:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940176256 00000100:00100000:2.0:1789428142.892294:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940176256 00000100:00100000:2.0:1789428142.892318:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789428142.892324:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22695:x1876350940176256:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789428142.892401:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22695:x1876350940176256:12345-0@lo:503:mount.lustre.0 Request processed in 76us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428142.892511:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789428142.892554:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940176256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789428142.895069:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22749:1876350940176384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789428142.895140:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428142.895175:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940176384 00000100:00100000:2.0:1789428142.895181:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940176384 00000100:00100000:2.0:1789428142.895219:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789428142.895228:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22749:x1876350940176384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789428142.895338:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22749:x1876350940176384:12345-0@lo:502:llog_process_th.0 Request processed in 111us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428142.895346:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789428142.895396:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789428142.896998:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22749:1876350940176384:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789428142.897128:0:22749:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789428142.897145:0:22749:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff919581ddb380) 00000020:00000080:2.0:1789428142.897164:0:22749:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789428142.897258:0:22749:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bbbf1000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789428142.897270:0:22749:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196bbbf1000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789428142.897273:0:22749:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bbbf1000 4 00010000:00080000:2.0:1789428142.897304:0:22749:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196905af800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1789428142.905931:0:22749:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789428142.911880:0:22749:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789428142.911927:0:22749:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789428142.911941:0:22749:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x84fc867ede519d6b 00000100:00080000:2.0:1789428142.911953:0:22749:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789428142.911965:0:22749:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9196905af800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428142.912003:0:22749:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958444ca80 x1876350940176512/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789428142.912042:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350940176512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789428142.912102:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789428142.912153:0:22749:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789428142.912335:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940176512 00000100:00100000:1.0:1789428142.912343:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940176512 00000100:00100000:1.0:1789428142.912370:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789428142.912378:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1876350940176512:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789428142.912479:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1876350940176512:12345-0@lo:38:llog_process_th.0 Request processed in 100us (375us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789428142.912485:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428142.912616:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789428142.912624:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196905af800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789428142.912627:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789428142.912631:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350940176512:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789428142.915338:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22749:1876350940176640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789428142.915538:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428142.915582:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940176640 00000100:00100000:2.0:1789428142.915589:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940176640 00000100:00100000:2.0:1789428142.915627:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789428142.915636:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22749:x1876350940176640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789428142.915758:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22749:x1876350940176640:12345-0@lo:502:llog_process_th.0 Request processed in 122us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428142.916529:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1789428142.916556:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22749:1876350940176640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789428142.916609:0:22749:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22749:1876350940176768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789428142.916653:0:22749:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428142.916670:0:22749:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195810d8cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428142.917922:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789428142.917971:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940176768 00000100:00100000:2.0:1789428142.917980:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940176768 00000100:00100000:2.0:1789428142.918009:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789428142.918016:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22749:x1876350940176768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789428142.918143:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22749:x1876350940176768:12345-0@lo:502:llog_process_th.0 Request processed in 126us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428142.918149:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789428142.918197:0:22749:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa80a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e871a47a-d8aa-4c92-86ef-047b0047c703:22749:1876350940176768:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789428142.918227:0:22749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789428142.918292:0:22695:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789428142.918315:0:22695:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789428142.918336:0:22695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583429e00/0x84fc867ede519d56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519d5d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.918347:0:22695:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583429e00/0x84fc867ede519d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519d5d expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789428142.918396:0:22695:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789428142.918398:0:22695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789428142.918400:0:22695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789428142.918401:0:22695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789428142.918402:0:22695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789428142.918404:0:22695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789428142.918405:0:22695:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789428142.918434:0:22695:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789428142.918437:0:22695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789428142.918439:0:22695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789428142.918442:0:22695:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789428142.918445:0:22695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789428142.918451:0:22695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789428142.918452:0:22695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789428142.918453:0:22695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789428142.918454:0:22695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789428142.918455:0:22695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789428142.918456:0:22695:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789428142.918456:0:22695:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789428142.918457:0:22695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789428142.918458:0:22695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789428142.918475:0:22695:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789428142.918487:0:22695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940176896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789428142.918521:0:22695:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428142.918538:0:22695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428142.918550:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940176896 00000100:00100000:2.0:1789428142.918554:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940176896 00000100:00100000:2.0:1789428142.918576:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789428142.918581:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22695:x1876350940176896:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789428142.918599:0:22710:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789428142.918611:0:22710:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789428142.928153:0:22710:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789428142.928525:0:22710:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789428142.928964:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22695:x1876350940176896:12345-0@lo:253:mount.lustre.0 Request processed in 10377us (10437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428142.928977:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789428142.929076:0:22695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:22695:1876350940176896:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789428142.929091:0:22695:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789428142.929095:0:22695:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789428142.929097:0:22695:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789428142.929106:0:22695:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428142.929108:0:22695:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428142.929109:0:22695:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428142.929111:0:22695:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428142.929112:0:22695:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789428142.929113:0:22695:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789428142.929115:0:22695:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428142.929116:0:22695:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789428142.929135:0:22695:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789428142.936868:0:22732:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789428142.936878:0:22732:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789428142.936917:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.936936:0:22732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583d1e600/0x84fc867ede519d41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519d3a expref: 11 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.936943:0:22732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.936987:0:22732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583d1e600/0x84fc867ede519d41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede519d3a expref: 11 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.937002:0:22732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583d1e600/0x84fc867ede519d41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede519d3a expref: 11 pid: 22710 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428142.937026:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940177024:0@lo:104: 00000100:00100000:2.0:1789428142.937085:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428142.937125:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c19edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789428142.937551:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940177024 00000100:00100000:2.0:1789428142.937560:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940177024 00000100:00100000:2.0:1789428142.937602:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428142.937610:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+3:22732:x1876350940177024:12345-0@lo:104: 00010000:00010000:2.0:1789428142.937624:0:22699:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519d41 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.937676:0:22699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789428142.937682:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+3:22732:x1876350940177024:12345-0@lo:104: Request processed in 72us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428142.937688:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789428142.937722:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428142.937727:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519d41 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.937734:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208a00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789428142.937738:0:22705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519d41 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.937746:0:22705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519d41 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789428142.937752:0:22705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519d41 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428142.937804:0:22705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789428142.937836:0:22705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519d41 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.937843:0:22705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789428142.937863:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519d41 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.937870:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208a00/0x84fc867ede519d3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519d41 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.937886:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428142.937887:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428142.937889:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428142.937926:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e871a47a-d8aa-4c92-86ef-047b0047c703:3616:1876350940177152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428142.937958:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428142.938023:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940177152 00000100:00100000:2.0:1789428142.938028:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940177152 00010000:00010000:2.0:1789428142.938044:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583d1e600/0x84fc867ede519d41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519d3a expref: 12 pid: 22710 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428142.938063:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428142.938068:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+12:3616:x1876350940177152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428142.938078:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428142.938082:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583d1e600/0x84fc867ede519d41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519d3a expref: 12 pid: 22710 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.938091:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583d1e600/0x84fc867ede519d41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede519d3a expref: 12 pid: 22710 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.938112:0:22701:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.938121:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789428142.938132:0:22701:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001255683s 00010000:00010000:2.0:1789428142.938137:0:22701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.938144:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.938151:0:22701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.938157:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.938162:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429c00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428142.938165:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.938172:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.938181:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.938189:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428142.938217:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+12:3616:x1876350940177152:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428142.938229:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428142.938264:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e871a47a-d8aa-4c92-86ef-047b0047c703:3616:1876350940177152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428142.938286:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1e600/0x84fc867ede519d41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede519d3a expref: 11 pid: 22710 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428142.938295:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940177024:0@lo:104: 00010000:00010000:2.0:1789428142.938305:0:22732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.938313:0:22732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.938317:0:22732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428142.938323:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583429c00/0x84fc867ede519d72 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789428142.958195:0:22695:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:0.0:1789428142.958915:0:22695:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789428142.960107:0:22757:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789428142.960307:0:22695:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:1.0:1789428142.961600:0:22758:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff91958361f480 x1876350940177280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428142.961617:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00000040:01000000:0.0:1789428142.962018:0:22695:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789428142.962072:0:22695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789428142.962542:0:22695:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789428142.962548:0:22695:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789428142.962579:0:22695:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789428142.963540:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789428142.964072:0:22695:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789428142.964105:0:22695:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789428142.965077:0:22757:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789428142.967112:0:22757:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789428142.967190:0:22757:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000020:00080000:2.0:1789428142.967732:0:22756:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:2.0:1789428142.967737:0:22756:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:00080000:0.0:1789428142.968349:0:22695:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1789428142.969145:0:22695:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1789428142.971379:0:22695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1789428142.973821:0:22695:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789428142.973860:0:22695:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb489c19cb988 00100000:10000000:0.0:1789428142.973868:0:22695:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789428142.974935:0:22695:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789428142.974950:0:22695:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789428142.974969:0:22695:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1789428142.974989:0:22695:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1789428142.975873:0:22695:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789428142.976076:0:22695:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789428143.539036:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428143.984671:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00000040:00080000:1.0:1789428143.988275:0:22751:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789428143.988400:0:22751:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789428143.991105:0:22751:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789428143.991118:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:0.0:1789428144.496719:0:22713:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789428144.496726:0:22713:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196bbbf1000 from 11 10000000:01000000:0.0:1789428144.496731:0:22713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789428144.496850:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428144.496865:0:22713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428144.496878:0:22713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428144.496917:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940177408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789428144.496985:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428144.497045:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195846eca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789428144.497103:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940177408 00000100:00100000:1.0:1789428144.497111:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940177408 00000100:00100000:1.0:1789428144.497167:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789428144.497176:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+11:22713:x1876350940177408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428144.497189:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428144.497202:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1fc00/0x84fc867ede519d80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519d79 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428144.497236:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1fc00/0x84fc867ede519d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519d79 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428144.497248:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1fc00/0x84fc867ede519d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519d79 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428144.497257:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1fc00, rc 0) 00000100:00100000:1.0:1789428144.497304:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22713:x1876350940177408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428144.497311:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789428144.497386:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940177408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428144.497401:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519d80 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428144.497410:0:22713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519d80 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428144.497484:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940177536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789428144.497514:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428144.497532:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195846eca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789428144.497582:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940177536 00000100:00100000:1.0:1789428144.497587:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940177536 00000100:00100000:1.0:1789428144.497616:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789428144.497633:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22713:x1876350940177536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789428144.497646:0:22710:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789428144.497662:0:22710:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789428144.497665:0:22710:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789428144.497767:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+12:22713:x1876350940177536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428144.497774:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789428144.497946:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940177536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789428144.497997:0:22713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789428144.498004:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519d80 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428144.498013:0:22713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519d80 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428144.562847:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428145.008644:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00000040:00080000:0.0:1789428145.008848:0:22751:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789428145.008853:0:22751:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789428145.008985:0:22751:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1789428145.009027:0:22751:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789428145.009182:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:2.0:1789428145.584640:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428146.032752:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00000001:02000400:2.0:1789428146.446666:0:23001:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789428146.608834:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428147.057635:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00000020:00000004:2.0:1789428147.154952:0:23053:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789428147.155126:0:23053:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789428147.633755:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789428147.834858:0:23103:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789428147.835032:0:23103:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1789428148.016813:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789428148.016821:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789428148.016838:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196bbb8e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428148.016846:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:2.0:1789428148.016852:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789428148.016864:0:469:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9196bbb8e000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428148.016885:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e871a47a-d8aa-4c92-86ef-047b0047c703:3613:1876350940177664:0@lo:400:kworker.0 00000100:00100000:2.0:1789428148.016892:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958444d180 x1876350940177792/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789428148.016912:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428148.016916:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789428148.016919:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428148.016922:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789428148.016936:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789428148.016940:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789428148.016941:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196905af800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428148.016950:0:469:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9196905af800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428148.016958:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428148.016965:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958444d500 x1876350940177920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789428148.016985:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940177792:0@lo:38:kworker.0 00000100:00100000:2.0:1789428148.017016:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428148.017034:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350940177920:0@lo:38:kworker.0 00000100:00100000:2.0:1789428148.017049:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428148.017111:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940177920 00000100:00100000:3.0:1789428148.017120:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940177920 00000100:00100000:3.0:1789428148.017159:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789428148.017166:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1876350940177920:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1789428148.017183:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940177792 00000100:00100000:0.0:1789428148.017188:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940177792 00010000:00080000:3.0:1789428148.017192:0:22718:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 492 last 0 00000100:00100000:0.0:1789428148.017206:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789428148.017211:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3612:x1876350940177792:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789428148.017230:0:22722:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:00000080:3.0:1789428148.017232:0:22718:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x84fc867ede519d87 00000004:00100000:3.0:1789428148.017247:0:22718:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1789428148.017270:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3612:x1876350940177792:12345-0@lo:38:kworker.0 Request processed in 56us (251us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789428148.017278:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789428148.017331:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbb8e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428148.017335:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789428148.017338:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940177792:0@lo:38:kworker.0 00000100:00080000:3.0:1789428148.017406:0:22718:0:(import.c:65:import_set_state_nolock()) ffff9196ade13000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428148.017481:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3612:x1876350940177920:12345-0@lo:38:kworker.0 Request processed in 315us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428148.017488:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789428148.017982:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91958444d500 x1876350940177920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789428148.017991:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789428148.017996:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789428148.017999:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789428148.018001:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196905af800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789428148.018004:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3612:1876350940177920:0@lo:38:kworker.0 00000100:00100000:1.0:1789428148.020303:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940177664 00000100:00100000:1.0:1789428148.020318:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940177664 00000100:00100000:1.0:1789428148.020383:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789428148.020395:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+12:3613:x1876350940177664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428148.020582:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+12:3613:x1876350940177664:12345-0@lo:400:kworker.0 Request processed in 188us (3623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428148.020607:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789428148.020728:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e871a47a-d8aa-4c92-86ef-047b0047c703:3613:1876350940177664:0@lo:400:kworker.0 00000100:00100000:1.0:1789428148.080551:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00010000:00010000:0.0:1789428148.657719:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428149.104741:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00010000:00010000:3.0:1789428149.680538:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428150.129049:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00010000:00010000:0.0:1789428150.708043:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428151.153161:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00010000:00010000:2.0:1789428151.728755:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428152.112771:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428142/real 1789428142] req@ffff91958444fb80 x1876350940174848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428152 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428152.112802:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91958444fb80 x1876350940174848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428152 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428152.112821:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428142/real 1789428142] req@ffff91958444c380 x1876350940174720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428152 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428152.112835:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91958444c380 x1876350940174720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428152 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789428152.112853:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bca11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428152.112875:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789428152.112879:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940174848:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789428152.112884:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9195848d7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428152.112889:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789428152.112892:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940174720:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789428152.112979:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789428152.112984:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789428152.112987:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196bbb8e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789428152.112993:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:1.0:1789428152.112998:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789428152.113008:0:469:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9196bbb8e000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428152.113028:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958361f800 x1876350940178176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789428152.113042:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428152.113046:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789428152.113047:0:469:0:(import.c:65:import_set_state_nolock()) ffff9195848d7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789428152.113050:0:469:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:1.0:1789428152.113053:0:469:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789428152.113057:0:469:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9195848d7800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428152.113069:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958361d180 x1876350940178304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789428152.113077:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428152.113080:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789428152.113081:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196bca11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789428152.113085:0:469:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:1.0:1789428152.113087:0:469:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789428152.113091:0:469:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9196bca11000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428152.113100:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958361f100 x1876350940178432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789428152.113151:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789428152.113163:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e871a47a-d8aa-4c92-86ef-047b0047c703:3613:1876350940178048:0@lo:400:kworker.0 00000100:00100000:1.0:1789428152.113222:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428152.113273:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940178560:0@lo:400:kworker.0 00000100:00100000:1.0:1789428152.113305:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428152.113349:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940178048 00000100:00100000:1.0:1789428152.113357:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940178048 00000100:00100000:2.0:1789428152.113382:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940178560 00000100:00100000:2.0:1789428152.113393:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940178560 00000100:00100000:1.0:1789428152.113402:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789428152.113433:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+12:3613:x1876350940178048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428152.113455:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428152.113465:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940178560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428152.113486:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+12:3613:x1876350940178048:12345-0@lo:400:kworker.0 Request processed in 73us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428152.113494:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789428152.113520:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940178560:12345-0@lo:400:kworker.0 Request processed in 56us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428152.113529:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789428152.113711:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e871a47a-d8aa-4c92-86ef-047b0047c703:3613:1876350940178048:0@lo:400:kworker.0 00010000:00080000:1.0:1789428152.113742:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91958361df80 x1876350940178560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428152.113752:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940178560:0@lo:400:kworker.0 00000100:00100000:1.0:1789428152.113766:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940178176:0@lo:38:kworker.0 00000100:00100000:1.0:1789428152.113797:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428152.115293:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940178304:0@lo:8:kworker.0 00000400:00000100:1.0:1789428152.115336:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940178304 offset 0 length 520: 4 00000100:00100000:1.0:1789428152.115360:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940178432:0@lo:8:kworker.0 00000400:00000100:1.0:1789428152.115377:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940178432 offset 0 length 520: 4 00000100:00100000:2.0:1789428152.115577:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940178176 00000100:00100000:2.0:1789428152.115586:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940178176 00000100:00100000:2.0:1789428152.115634:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789428152.115641:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3612:x1876350940178176:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789428152.115669:0:22722:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789428152.115722:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3612:x1876350940178176:12345-0@lo:38:kworker.0 Request processed in 80us (1924us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789428152.115729:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789428152.116111:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbb8e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789428152.116129:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789428152.116134:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940178176:0@lo:38:kworker.0 00000100:00100000:2.0:1789428152.179695:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00010000:00010000:0.0:1789428152.755092:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428153.200491:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00000020:01000004:0.0:1789428153.484218:0:23448:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789428153.484220:0:23448:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789428153.484222:0:23448:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789428153.484294:0:23448:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff919583218800 00000020:01000004:0.0:1789428153.484306:0:23448:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789428153.484316:0:23448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789428153.484328:0:23448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff919688890000) 00000020:00000080:0.0:1789428153.484344:0:23448:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789428153.545014:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789428153.545275:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:1.0:1789428153.548820:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1789428153.549199:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789428153.549638:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1789428153.550234:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789428153.550816:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1789428153.551185:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1789428153.551597:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1789428153.551975:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1789428153.552232:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1789428153.552516:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789428153.552948:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789428153.553222:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789428153.554238:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789428153.554514:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:1.0:1789428153.554832:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1789428153.555194:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1789428153.555436:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789428153.555716:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1789428153.555960:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789428153.556273:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:1.0:1789428153.556625:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1789428153.556934:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:1.0:1789428153.557218:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1789428153.557510:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789428153.558005:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789428153.558265:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789428153.558628:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789428153.558928:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789428153.559180:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789428153.559446:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789428153.559705:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1789428153.559911:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789428153.560058:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1789428153.560268:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1789428153.560476:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789428153.560700:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1789428153.560940:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789428153.561167:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789428153.561409:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789428153.561702:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789428153.561925:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1789428153.562182:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1789428153.562474:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789428153.562693:0:23448:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00080000:01000000:0.0:1789428153.564207:0:23448:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789428153.564518:0:23448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789428153.564529:0:23448:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789428153.564554:0:23448:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede519d95 00000020:01000004:0.0:1789428153.564560:0:23448:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789428153.564581:0:23448:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.124@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789428153.564585:0:23448:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789428153.564591:0:23448:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789428153.564627:0:23448:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789428153.564632:0:23448:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789428153.567844:0:23448:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789428153.567928:0:23448:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.124@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1789428153.567932:0:23448:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789428153.567934:0:23448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789428153.567937:0:23448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428153.567938:0:23448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428153.567939:0:23448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428153.567940:0:23448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428153.567941:0:23448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789428153.567942:0:23448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428153.567942:0:23448:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789428153.567945:0:23448:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1789428153.567947:0:23448:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789428153.567947:0:23448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789428153.567948:0:23448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428153.567949:0:23448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428153.567949:0:23448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428153.567950:0:23448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428153.567950:0:23448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789428153.567951:0:23448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428153.567952:0:23448:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789428153.567980:0:23448:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789428153.567996:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940178688:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789428153.568059:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428153.568209:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789428153.568243:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940178688 00000100:00100000:3.0:1789428153.568249:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940178688 00000100:00100000:3.0:1789428153.568326:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789428153.568334:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+12:23448:x1876350940178688:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789428153.568357:0:22711:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789428153.568360:0:22711:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1789428153.568366:0:22711:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789428153.568627:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+12:23448:x1876350940178688:12345-0@lo:253:mount.lustre.0 Request processed in 293us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428153.568635:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789428153.568689:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940178688:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789428153.568699:0:23448:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789428153.568701:0:23448:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789428153.568702:0:23448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789428153.568703:0:23448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428153.568704:0:23448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428153.568705:0:23448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428153.568706:0:23448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428153.568707:0:23448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789428153.568709:0:23448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428153.568710:0:23448:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789428153.568727:0:23448:0:(tgt_mount.c:101:server_register_mount()) register mount ffff919583218800 from lustre-MDT0001 10000000:01000000:0.0:1789428153.568757:0:23448:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789428153.568760:0:23448:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789428153.568766:0:23448:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff919688450000 local copy 00010000:00010000:0.0:1789428153.568778:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519c92 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428153.568869:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940178816:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428153.568893:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428153.569334:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940178816 00000100:00100000:3.0:1789428153.569339:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940178816 00000100:00100000:3.0:1789428153.569380:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789428153.569388:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+12:23448:x1876350940178816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428153.569467:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+12:23448:x1876350940178816:12345-0@lo:501:mount.lustre.0 Request processed in 79us (571us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789428153.569474:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789428153.569514:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca636c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428153.569527:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940178816:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789428153.569541:0:23448:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789428153.569559:0:23448:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789428153.569565:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519c92 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.569586:0:23448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519c92 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428153.569629:0:23448:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff919583218800 10000000:01000000:3.0:1789428153.569634:0:23448:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789428153.569639:0:23448:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff919688450000 10000000:01000000:3.0:1789428153.569641:0:23448:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789428153.569643:0:23448:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff919688450000 from 1 10000000:01000000:3.0:1789428153.569645:0:23448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789428153.569672:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196c21e9000/0x84fc867ede519d9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.569680:0:23448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196c21e9000/0x84fc867ede519d9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.569688:0:23448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196c21e9000/0x84fc867ede519d9c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428153.569701:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940178944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789428153.569726:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428153.569745:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbc28d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789428153.569763:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940178944 00000100:00100000:1.0:1789428153.569768:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940178944 00000100:00100000:1.0:1789428153.569797:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789428153.569804:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+12:23448:x1876350940178944:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428153.569812:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428153.569824:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1e800/0x84fc867ede519da3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519d9c expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.569845:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1e800/0x84fc867ede519da3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519d9c expref: 13 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.569923:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1e800/0x84fc867ede519da3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519d9c expref: 13 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.569933:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e800, rc 0) 00000100:00100000:1.0:1789428153.570017:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+13:23448:x1876350940178944:12345-0@lo:101:mount.lustre.0 Request processed in 213us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.570024:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789428153.570080:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa80000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940178944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428153.570092:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196c21e9000/0x84fc867ede519d9c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519da3 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.570100:0:23448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196c21e9000/0x84fc867ede519d9c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519da3 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428153.570182:0:23448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789428153.570198:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196c21e9000/0x84fc867ede519d9c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519da3 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.570205:0:23448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196c21e9000/0x84fc867ede519d9c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519da3 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428153.570212:0:23448:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff919583218800 10000000:01000000:0.0:1789428153.570215:0:23448:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789428153.570218:0:23448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff919583218800 from 1 10000000:01000000:0.0:1789428153.570220:0:23448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789428153.570234:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208800/0x84fc867ede519daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.570240:0:23448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208800/0x84fc867ede519daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.570247:0:23448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208800/0x84fc867ede519daa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428153.570265:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940179072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789428153.570291:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428153.570924:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63300 going to sleep for 11 seconds 00000100:00100000:1.0:1789428153.571044:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940179072 00000100:00100000:1.0:1789428153.571051:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940179072 00000100:00100000:2.0:1789428153.571249:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789428153.571258:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+13:23448:x1876350940179072:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428153.571267:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428153.571279:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583429200/0x84fc867ede519db1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519daa expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.571298:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429200/0x84fc867ede519db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519daa expref: 14 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.571308:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583429200/0x84fc867ede519db1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519daa expref: 14 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.571397:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429200, rc 0) 00000100:00100000:2.0:1789428153.571477:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+14:23448:x1876350940179072:12345-0@lo:101:mount.lustre.0 Request processed in 221us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428153.571485:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789428153.571556:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940179072:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428153.571569:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208800/0x84fc867ede519daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519db1 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.571577:0:23448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208800/0x84fc867ede519daa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519db1 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428153.571602:0:23448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789428153.571629:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208800/0x84fc867ede519daa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519db1 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.571637:0:23448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208800/0x84fc867ede519daa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519db1 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428153.571644:0:23448:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789428153.571649:0:23448:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789428153.571654:0:23448:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff919583218800 10000000:01000000:3.0:1789428153.571657:0:23448:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789428153.571660:0:23448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789428153.571663:0:23448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789428153.571680:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196c21e9800/0x84fc867ede519db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.571688:0:23448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196c21e9800/0x84fc867ede519db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.571695:0:23448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196c21e9800/0x84fc867ede519db8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428153.571709:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940179200:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789428153.571737:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428153.571765:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbc28240 going to sleep for 11 seconds 00000100:00100000:1.0:1789428153.571774:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940179200 00000100:00100000:1.0:1789428153.571779:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940179200 00000100:00100000:1.0:1789428153.571808:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789428153.571815:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+14:23448:x1876350940179200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428153.571823:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428153.571831:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1f800/0x84fc867ede519dbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519db8 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.571926:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1f800/0x84fc867ede519dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519db8 expref: 15 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.571936:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1f800/0x84fc867ede519dbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519db8 expref: 15 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.571943:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f800, rc 0) 00000100:00100000:1.0:1789428153.571975:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+15:23448:x1876350940179200:12345-0@lo:101:mount.lustre.0 Request processed in 161us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.571982:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789428153.572056:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940179200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428153.572067:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196c21e9800/0x84fc867ede519db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519dbf expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.572075:0:23448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196c21e9800/0x84fc867ede519db8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519dbf expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789428153.575411:0:23448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1789428153.576725:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789428153.582248:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1789428153.582307:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1789428153.582402:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1789428153.582648:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1789428153.582740:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1789428153.582759:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1789428153.582775:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1789428153.582804:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1789428153.582820:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1789428153.582835:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1789428153.582850:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1789428153.583049:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1789428153.583064:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1789428153.583083:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1789428153.583097:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1789428153.583197:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1789428153.583208:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1789428153.583219:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1789428153.583230:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1789428153.583241:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1789428153.583256:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1789428153.583269:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1789428153.583280:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1789428153.583296:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1789428153.583309:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1789428153.583393:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1789428153.583407:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1789428153.583500:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1789428153.583519:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1789428153.583613:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1789428153.583637:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1789428153.583653:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1789428153.583680:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1789428153.583697:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1789428153.583714:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1789428153.583730:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1789428153.583745:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1789428153.583761:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1789428153.583776:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1789428153.583790:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1789428153.583804:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1789428153.583820:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1789428153.583835:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1789428153.583849:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1789428153.584005:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1789428153.584012:0:23448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1789428153.584181:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940179328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428153.584259:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428153.584434:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940179328 00000100:00100000:0.0:1789428153.584441:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940179328 00000100:00100000:0.0:1789428153.584491:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789428153.584500:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+15:23448:x1876350940179328:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428153.584633:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789428153.584967:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+15:23448:x1876350940179328:12345-0@lo:501:mount.lustre.0 Request processed in 467us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428153.584975:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789428153.585051:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940179328:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428153.585084:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940179456:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789428153.585193:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428153.585222:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789428153.585441:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940179456 00000100:00100000:3.0:1789428153.585448:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940179456 00000100:00100000:3.0:1789428153.585484:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789428153.585499:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+15:23448:x1876350940179456:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428153.586216:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+15:23448:x1876350940179456:12345-0@lo:503:mount.lustre.0 Request processed in 716us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428153.586223:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789428153.586304:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940179456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789428153.588061:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789428153.588287:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940179584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428153.588515:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428153.588648:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbc28480 going to sleep for 11 seconds 00000100:00100000:0.0:1789428153.588750:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940179584 00000100:00100000:0.0:1789428153.588758:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940179584 00000100:00100000:0.0:1789428153.588808:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789428153.588817:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+15:23448:x1876350940179584:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428153.589889:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+15:23448:x1876350940179584:12345-0@lo:502:mount.lustre.0 Request processed in 1070us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428153.589900:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789428153.590026:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940179584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428153.590308:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789428153.590405:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1789428153.590510:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1789428153.590528:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1789428153.590653:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1789428153.590742:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1789428153.590760:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1789428153.590776:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1789428153.590790:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1789428153.590804:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1789428153.590819:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1789428153.590834:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1789428153.590849:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1789428153.590938:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1789428153.590953:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1789428153.590967:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1789428153.590983:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1789428153.590998:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1789428153.591013:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1789428153.591028:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1789428153.591057:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1789428153.591073:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1789428153.591088:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1789428153.591179:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1789428153.591201:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1789428153.591235:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1789428153.591252:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1789428153.591266:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1789428153.591281:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1789428153.591295:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1789428153.591384:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1789428153.591406:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1789428153.591621:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1789428153.591642:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1789428153.591657:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1789428153.591746:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1789428153.591763:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1789428153.591779:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1789428153.591795:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1789428153.591812:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1789428153.591825:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1789428153.591926:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1789428153.591946:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1789428153.591960:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1789428153.592002:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940179712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428153.592066:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428153.592213:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940179712 00000100:00100000:1.0:1789428153.592221:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940179712 00000100:00100000:3.0:1789428153.592336:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbc28480 going to sleep for 11 seconds 00000100:00100000:1.0:1789428153.592525:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789428153.592546:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+15:23448:x1876350940179712:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428153.592806:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+15:23448:x1876350940179712:12345-0@lo:502:mount.lustre.0 Request processed in 272us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.592813:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789428153.592912:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940179712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428153.592961:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1789428153.592970:0:23448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1789428153.594034:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428153.594051:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428153.594053:0:23452:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789428153.594059:0:23452:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789428153.594062:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789428153.594076:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff91958455b380) 00000020:00000080:3.0:1789428153.594098:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789428153.594115:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789428153.594188:0:23452:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789428153.594196:0:23452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede519dcd 00000020:00000080:3.0:1789428153.594455:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789428153.594460:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428153.594465:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428153.594466:0:23452:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789428153.594469:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428153.594473:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428153.594474:0:23452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789428153.594478:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789428153.594485:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9195845599c0) 00000020:00000080:3.0:1789428153.594496:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789428153.594500:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789428153.594502:0:23452:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789428153.594504:0:23452:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789428153.594510:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789428153.594583:0:23452:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919583218800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789428153.594596:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9196bcb43380) 00000020:00000080:3.0:1789428153.594617:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789428153.595046:0:23452:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789428153.595053:0:23452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede519de2 00000020:00000080:3.0:1789428153.595164:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789428153.595171:0:23452:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789428153.595175:0:23452:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x84fc867ede519de9 00080000:01000000:3.0:1789428153.595405:0:23452:0:(osd_handler.c:8926:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789428153.595467:0:23452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede519df0 00010000:00010000:3.0:1789428153.679031:0:23452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1789428153.679724:0:23452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1789428153.680161:0:23452:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789428153.687072:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1789428153.687201:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428153.687209:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428153.687212:0:23452:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1789428153.687215:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789428153.687221:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428153.687222:0:23452:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1789428153.687225:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789428153.687230:0:23452:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:00000080:1.0:1789428153.687256:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789428153.687270:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff91958302cd40) 00000020:00000080:1.0:1789428153.687299:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1789428153.687307:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789428153.687492:0:23452:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1789428153.687499:0:23452:0:(osd_handler.c:8926:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789428153.687506:0:23452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede519dfe 00010000:00080000:1.0:1789428153.687746:0:23452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196905ea800@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.124@tcp at head 00010000:00010000:1.0:1789428153.690259:0:23452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789428153.692062:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789428153.692078:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789428153.692135:0:23452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789428153.692158:0:23452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede519e05 00000100:00080000:0.0:1789428153.692168:0:23452:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789428153.692179:0:23452:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9196905ea800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428153.692217:0:23452:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfb8ca80 x1876350940179840/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428153.692248:0:23452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789428153.692350:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428153.692355:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428153.692357:0:23452:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789428153.692360:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789428153.692363:0:23452:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789428153.692365:0:23452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789428153.692366:0:23452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789428153.692367:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789428153.692370:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428153.692371:0:23452:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789428153.692373:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428153.692377:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428153.692379:0:23452:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789428153.692382:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789428153.692436:0:23452:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789428153.692453:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428153.692457:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428153.692458:0:23452:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789428153.692461:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789428153.692463:0:23452:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:0.0:1789428153.692464:0:23452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789428153.692466:0:23452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789428153.692467:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789428153.692471:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428153.692472:0:23452:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789428153.692475:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789428153.692478:0:23452:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789428153.692481:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428153.692482:0:23452:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789428153.692486:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789428153.692490:0:23452:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:0.0:1789428153.692513:0:23452:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789428153.692515:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789428153.692531:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9196888919c0) 00000020:00000080:0.0:1789428153.692920:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789428153.692928:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789428153.693012:0:23452:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789428153.693020:0:23452:0:(osd_handler.c:8926:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789428153.693028:0:23452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede519e13 00010000:00080000:0.0:1789428153.693057:0:23452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196bc9e4000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.124@tcp at head 00010000:00010000:0.0:1789428153.693404:0:23452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1789428153.693687:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940179840:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789428153.693773:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789428153.693839:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789428153.693844:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789428153.693848:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196bbb8e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789428153.693853:0:469:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1789428153.693858:0:469:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789428153.693865:0:469:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9196bbb8e000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428153.693890:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958361d500 x1876350940179968/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789428153.693909:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428153.693912:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789428153.693915:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428153.693917:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789428153.693956:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940179840 00000100:00100000:1.0:1789428153.693963:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940179840 00000100:00100000:1.0:1789428153.693993:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789428153.694000:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3612:x1876350940179840:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789428153.694023:0:22722:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:1.0:1789428153.694059:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede519e1a 00000004:00100000:1.0:1789428153.694073:0:22722:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789428153.694095:0:22722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:1.0:1789428153.694165:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940180096:0@lo:400:kworker.0 00000100:00100000:1.0:1789428153.694196:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428153.694236:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940180096 00000100:00100000:1.0:1789428153.694240:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940180096 00000100:00100000:1.0:1789428153.694272:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789428153.694280:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940180096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428153.694342:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940180096:12345-0@lo:400:kworker.0 Request processed in 63us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.694348:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789428153.694387:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91958361c380 x1876350940180096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428153.694400:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940180096:0@lo:400:kworker.0 00000100:00100000:1.0:1789428153.694449:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940179968:0@lo:38:kworker.0 00000100:00100000:1.0:1789428153.694473:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428153.694498:0:22721:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789428153.694505:0:22721:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789428153.695510:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940179968 00000100:00100000:1.0:1789428153.695518:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940179968 00000040:01000000:0.0:1789428153.697243:0:23452:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789428153.698242:0:23452:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789428153.704099:0:23452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789428153.704994:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1789428153.705348:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1789428153.705753:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428153.705763:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3612:x1876350940179968:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789428153.705867:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3612:x1876350940179968:12345-0@lo:38:kworker.0 Request processed in 104us (11393us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789428153.705875:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789428153.706466:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789428153.706476:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbb8e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428153.706481:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789428153.706485:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940179968:0@lo:38:kworker.0 00000040:00080000:2.0:1789428153.706773:0:23458:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789428153.706778:0:23458:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789428153.707477:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789428153.707488:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789428153.707525:0:23452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789428153.707758:0:23452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede519e21 00000100:00080000:1.0:1789428153.707768:0:23452:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789428153.707778:0:23452:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9196bc9e4000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428153.707817:0:23452:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958361ca80 x1876350940180224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789428153.707844:0:23452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789428153.707894:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428153.707898:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428153.707900:0:23452:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789428153.707903:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789428153.707906:0:23452:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789428153.707907:0:23452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789428153.707909:0:23452:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789428153.707910:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789428153.707913:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428153.707914:0:23452:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789428153.707916:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789428153.707920:0:23452:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789428153.707923:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428153.707925:0:23452:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789428153.707927:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789428153.707931:0:23452:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.124@tcp to nid 0x20000c0a8ca7c (192.168.202.124@tcp) 00000020:01000000:1.0:1789428153.707952:0:23452:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789428153.707954:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789428153.707965:0:23452:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9195830299c0) 00000020:00000080:1.0:1789428153.707976:0:23452:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789428153.707980:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789428153.708031:0:23452:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789428153.708037:0:23452:0:(osd_handler.c:8926:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789428153.708042:0:23452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x84fc867ede519e2f 00010000:00080000:1.0:1789428153.708069:0:23452:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919692afd000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.124@tcp at head 00010000:00010000:1.0:1789428153.708265:0:23452:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789428153.708342:0:23452:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789428153.708356:0:23452:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1789428153.708797:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940180224:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789428153.708847:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940180224 offset 0 length 520: 4 00000100:00080000:2.0:1789428153.709263:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428153.709268:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789428153.709271:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428153.709274:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789428153.710884:0:22722:0:(import.c:65:import_set_state_nolock()) ffff919692afa000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789428153.711037:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3612:x1876350940179840:12345-0@lo:38:llog_process_th.0 Request processed in 17034us (17262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.711048:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1789428153.711220:0:23452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789428153.711715:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1789428153.711885:0:23452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00100000:0.0:1789428153.712623:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789428153.712634:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789428153.712642:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789428153.712647:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789428153.712651:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196905ea800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789428153.712677:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940179840:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789428153.712979:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940180352:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789428153.713034:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428153.713133:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940180352 00000100:00100000:2.0:1789428153.713139:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940180352 00000100:00100000:2.0:1789428153.713187:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789428153.713198:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1876350940180352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789428153.713229:0:22721:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789428153.713277:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1876350940180352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428153.713292:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789428153.713460:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940180352:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789428153.714481:0:23460:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1789428153.714486:0:23460:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789428153.715818:0:23452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789428153.715831:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789428153.715871:0:23452:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789428153.715892:0:23452:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede519e36 00000100:00080000:1.0:1789428153.715901:0:23452:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789428153.715911:0:23452:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff919692afd000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428153.715943:0:23452:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958361e680 x1876350940180480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789428153.716002:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940180480:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789428153.716067:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940180480 offset 0 length 520: 4 00000100:00080000:1.0:1789428153.716140:0:23452:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789428153.716197:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428153.716202:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428153.716204:0:23452:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789428153.716208:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789428153.716211:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428153.716213:0:23452:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789428153.716216:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789428153.716217:0:23452:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789428153.716219:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428153.716222:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428153.716228:0:23452:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789428153.716231:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789428153.716234:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428153.716235:0:23452:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789428153.716238:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789428153.716267:0:23452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428153.716271:0:23452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428153.716272:0:23452:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789428153.716276:0:23452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:2.0:1789428153.716575:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428153.716580:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789428153.716582:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428153.716585:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1789428153.716812:0:23448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789428153.716844:0:23448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789428153.716894:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196c21e9800/0x84fc867ede519db8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519dbf expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.716907:0:23448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196c21e9800/0x84fc867ede519db8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519dbf expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428153.716915:0:23448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919583218800 from 1 10000000:01000000:0.0:1789428153.716918:0:23448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789428153.716944:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.716952:0:23448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.716963:0:23448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428153.716979:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940180608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789428153.717021:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428153.717052:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195846ec780 going to sleep for 11 seconds 00000100:00100000:1.0:1789428153.717140:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940180608 00000100:00100000:1.0:1789428153.717147:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940180608 00000100:00100000:1.0:1789428153.717192:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789428153.717202:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+15:23448:x1876350940180608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428153.717213:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428153.717226:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1ec00/0x84fc867ede519e44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519e3d expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.717247:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1ec00/0x84fc867ede519e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519e3d expref: 16 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.717257:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1ec00/0x84fc867ede519e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519e3d expref: 16 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.717265:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1ec00, rc 0) 00000100:00100000:0.0:1789428153.717405:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940180608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428153.717434:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e44 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.717443:0:23448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519e44 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428153.717958:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940180736:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789428153.717992:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428153.718005:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195846ec780 going to sleep for 11 seconds 00000100:00100000:1.0:1789428153.718183:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+16:23448:x1876350940180608:12345-0@lo:101:mount.lustre.0 Request processed in 109us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.718189:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789428153.718215:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940180736 00000100:00100000:1.0:1789428153.718218:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940180736 00000100:00100000:1.0:1789428153.718230:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789428153.718234:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+16:23448:x1876350940180736:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789428153.718250:0:22709:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789428153.718261:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789428153.718262:0:22709:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1789428153.718372:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+16:23448:x1876350940180736:12345-0@lo:256:mount.lustre.0 Request processed in 137us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.718377:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789428153.718521:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940180736:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789428153.719244:0:23448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789428153.719652:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e44 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.719757:0:23448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e44 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428153.719766:0:23448:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919583218800 from 1 10000000:01000000:0.0:1789428153.719769:0:23448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789428153.719798:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.719806:0:23448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.719815:0:23448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428153.719831:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940180864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789428153.719875:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428153.719946:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195846ec780 going to sleep for 11 seconds 00000100:00100000:1.0:1789428153.719986:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940180864 00000100:00100000:1.0:1789428153.719992:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940180864 00000100:00100000:1.0:1789428153.720064:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789428153.720073:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+16:23448:x1876350940180864:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428153.720158:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428153.720171:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1ea00/0x84fc867ede519e52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519e4b expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.720194:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1ea00/0x84fc867ede519e52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519e4b expref: 17 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.720205:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1ea00/0x84fc867ede519e52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519e4b expref: 17 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.720212:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1ea00, rc 0) 00000100:00100000:1.0:1789428153.720286:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+17:23448:x1876350940180864:12345-0@lo:101:mount.lustre.0 Request processed in 215us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.720293:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789428153.720410:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940180864:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428153.720622:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e52 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.720646:0:23448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519e52 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789428153.721916:0:23448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1789428153.722274:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789428153.728904:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1789428153.728965:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1789428153.728983:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1789428153.728998:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1789428153.729013:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1789428153.729026:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1789428153.729040:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1789428153.729055:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1789428153.729069:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1789428153.729084:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1789428153.729399:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1789428153.729447:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1789428153.729454:0:23448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1789428153.729571:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940180992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428153.729649:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428153.729691:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195846ecb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789428153.729755:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940180992 00000100:00100000:3.0:1789428153.729764:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940180992 00000100:00100000:3.0:1789428153.729848:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789428153.729859:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+17:23448:x1876350940180992:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428153.729977:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+17:23448:x1876350940180992:12345-0@lo:501:mount.lustre.0 Request processed in 120us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428153.729984:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789428153.730031:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940180992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428153.730062:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181120:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428153.730585:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428153.730615:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195846ecb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789428153.731488:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940181120 00000100:00100000:1.0:1789428153.731497:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940181120 00000100:00100000:1.0:1789428153.731645:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789428153.731655:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+17:23448:x1876350940181120:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789428153.731800:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+17:23448:x1876350940181120:12345-0@lo:503:mount.lustre.0 Request processed in 146us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.731807:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789428153.732238:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181120:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789428153.732696:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789428153.732780:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181248:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428153.732828:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428153.732867:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195846ec780 going to sleep for 11 seconds 00000100:00100000:1.0:1789428153.733455:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940181248 00000100:00100000:1.0:1789428153.733462:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940181248 00000100:00100000:1.0:1789428153.733505:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789428153.733513:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+17:23448:x1876350940181248:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428153.733630:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+17:23448:x1876350940181248:12345-0@lo:502:mount.lustre.0 Request processed in 117us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.733638:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789428153.733978:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181248:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789428153.734487:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789428153.734532:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1789428153.734549:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1789428153.734562:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1789428153.734574:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1789428153.734588:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1789428153.735190:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1789428153.735288:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1789428153.735305:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789428153.735393:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1789428153.735407:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1789428153.735466:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181376:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428153.735541:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428153.735581:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195846ec780 going to sleep for 11 seconds 00000100:00100000:2.0:1789428153.735772:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940181376 00000100:00100000:2.0:1789428153.735780:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940181376 00000100:00100000:2.0:1789428153.735816:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789428153.735826:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+17:23448:x1876350940181376:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428153.735936:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+17:23448:x1876350940181376:12345-0@lo:502:mount.lustre.0 Request processed in 112us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428153.735943:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789428153.736004:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181376:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789428153.736053:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:0.0:1789428153.736060:0:23448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789428153.737752:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428153.737765:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428153.737767:0:23462:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789428153.737775:0:23462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919583218800 00000020:00000080:3.0:1789428153.737777:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428153.737784:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428153.737786:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428153.737788:0:23462:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789428153.737790:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428153.737792:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428153.737793:0:23462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789428153.737796:0:23462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919583218800 00000020:00000080:3.0:1789428153.737797:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428153.737844:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428153.737848:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428153.737849:0:23462:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789428153.737852:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428153.737855:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428153.737856:0:23462:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789428153.737860:0:23462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919583218800 00000020:00000080:3.0:1789428153.737867:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428153.737887:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428153.737890:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428153.737891:0:23462:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789428153.737894:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789428153.737897:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428153.737898:0:23462:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789428153.737901:0:23462:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919583218800 00000020:00000080:3.0:1789428153.737903:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789428153.737924:0:23462:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428153.737928:0:23462:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428153.737929:0:23462:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789428153.737931:0:23462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1789428153.738154:0:23448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789428153.738183:0:23448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789428153.738200:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e52 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.738212:0:23448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e52 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428153.738265:0:23448:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789428153.738269:0:23448:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff919583218800 10000000:01000000:2.0:1789428153.738272:0:23448:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff919583218800 10000000:01000000:2.0:1789428153.738276:0:23448:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789428153.738282:0:23448:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff919583218800 from 1 10000000:01000000:2.0:1789428153.738285:0:23448:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789428153.738334:0:23448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583428600/0x84fc867ede519e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.738343:0:23448:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583428600/0x84fc867ede519e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.738353:0:23448:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583428600/0x84fc867ede519e59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428153.738375:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789428153.738453:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428153.738485:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789428153.738504:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940181504 00000100:00100000:2.0:1789428153.738511:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940181504 00000100:00100000:2.0:1789428153.738555:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789428153.738564:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+17:23448:x1876350940181504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428153.738575:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428153.738587:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583429600/0x84fc867ede519e60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519e59 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.738617:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429600/0x84fc867ede519e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519e59 expref: 18 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.738628:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583429600/0x84fc867ede519e60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519e59 expref: 18 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.738635:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429600, rc 0) 00000100:00100000:2.0:1789428153.738846:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+18:23448:x1876350940181504:12345-0@lo:101:mount.lustre.0 Request processed in 282us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428153.738852:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789428153.738906:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428153.738919:0:23448:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583428600/0x84fc867ede519e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e60 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.738927:0:23448:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583428600/0x84fc867ede519e59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519e60 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789428153.740879:0:23448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1789428153.741151:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789428153.742758:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1789428153.742804:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1789428153.742820:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1789428153.742833:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1789428153.742848:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1789428153.743300:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1789428153.743384:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1789428153.743401:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1789428153.743760:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1789428153.743781:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1789428153.743795:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1789428153.743808:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1789428153.743822:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1789428153.743836:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1789428153.743849:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1789428153.744488:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1789428153.744502:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1789428153.744515:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1789428153.744527:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1789428153.744789:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1789428153.744807:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1789428153.744832:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1789428153.744867:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1789428153.744882:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1789428153.744896:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1789428153.744909:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1789428153.744921:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1789428153.744934:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1789428153.744947:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1789428153.744960:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1789428153.744973:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1789428153.744986:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1789428153.744999:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1789428153.745012:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1789428153.745025:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1789428153.745038:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1789428153.745050:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1789428153.745075:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1789428153.745107:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1789428153.745123:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1789428153.745137:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1789428153.745150:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1789428153.745162:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1789428153.745176:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1789428153.745188:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1789428153.745201:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1789428153.745213:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1789428153.745226:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1789428153.745404:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1789428153.745443:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1789428153.745462:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1789428153.745468:0:23448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1789428153.745599:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428153.745690:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428153.745744:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789428153.746300:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940181632 00000100:00100000:3.0:1789428153.746370:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940181632 00000100:00100000:3.0:1789428153.746447:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789428153.746457:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:23448:x1876350940181632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428153.746578:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:23448:x1876350940181632:12345-0@lo:501:mount.lustre.0 Request processed in 123us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428153.746586:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789428153.749005:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181632:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428153.749062:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181760:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789428153.749128:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428153.749165:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940181760 00000100:00100000:2.0:1789428153.749171:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940181760 00000100:00100000:2.0:1789428153.749213:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789428153.749222:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+18:23448:x1876350940181760:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789428153.749321:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+18:23448:x1876350940181760:12345-0@lo:503:mount.lustre.0 Request processed in 100us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428153.749329:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789428153.749377:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bca63e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789428153.749389:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181760:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789428153.750391:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789428153.750490:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181888:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428153.750650:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428153.750754:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940181888 00000100:00100000:2.0:1789428153.750760:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940181888 00000100:00100000:2.0:1789428153.750789:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789428153.750796:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+18:23448:x1876350940181888:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428153.750949:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+18:23448:x1876350940181888:12345-0@lo:502:mount.lustre.0 Request processed in 154us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428153.750957:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789428153.750998:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adb30600 going to sleep for 11 seconds 00000100:00100000:2.0:1789428153.751014:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940181888:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789428153.751387:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1789428153.751438:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1789428153.751458:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1789428153.751473:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1789428153.751487:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1789428153.751500:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1789428153.751513:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1789428153.751526:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1789428153.751949:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1789428153.751969:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1789428153.751984:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1789428153.751998:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1789428153.752012:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1789428153.752026:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1789428153.752039:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1789428153.752067:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1789428153.752084:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1789428153.752401:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1789428153.752475:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1789428153.752493:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1789428153.752507:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1789428153.752521:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1789428153.752973:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1789428153.752997:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1789428153.753012:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1789428153.753025:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1789428153.753039:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1789428153.753052:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1789428153.753064:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1789428153.753076:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1789428153.753379:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1789428153.753638:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1789428153.753928:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1789428153.753948:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1789428153.753961:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1789428153.753974:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1789428153.753985:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1789428153.753996:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1789428153.754007:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1789428153.754019:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1789428153.754031:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1789428153.754044:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1789428153.754057:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1789428153.754068:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1789428153.754079:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1789428153.754382:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1789428153.754401:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1789428153.754501:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1789428153.754942:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940182016:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428153.755012:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428153.755058:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940182016 00000100:00100000:2.0:1789428153.755066:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940182016 00000100:00100000:2.0:1789428153.755397:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789428153.755406:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:23448:x1876350940182016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428153.755974:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:23448:x1876350940182016:12345-0@lo:502:mount.lustre.0 Request processed in 568us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428153.755983:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789428153.756042:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adb30600 going to sleep for 11 seconds 00000100:00100000:2.0:1789428153.756067:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940182016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789428153.757212:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1789428153.757254:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1789428153.757300:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940182144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428153.757768:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428153.757815:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940182144 00000100:00100000:2.0:1789428153.757823:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940182144 00000100:00100000:2.0:1789428153.758400:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789428153.758436:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+18:23448:x1876350940182144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428153.760529:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adb30600 going to sleep for 11 seconds 00000100:00100000:2.0:1789428153.760702:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+18:23448:x1876350940182144:12345-0@lo:502:mount.lustre.0 Request processed in 2288us (2928us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428153.760716:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789428153.761183:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940182144:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789428153.761680:0:23448:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1789428153.761696:0:23448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789428153.763854:0:23467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789428153.763870:0:23467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff919583028000) 00000020:00000080:1.0:1789428153.763893:0:23467:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789428153.763967:0:23467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919583218800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789428153.763971:0:23467:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919583218800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789428153.763974:0:23467:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919583218800 3 00010000:00080000:1.0:1789428153.764003:0:23467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196ade17800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.124@tcp at head 00010000:00010000:1.0:1789428153.771559:0:23467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1789428153.773316:0:23467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789428153.773366:0:23467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789428153.773378:0:23467:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x84fc867ede519e6e 00000100:00080000:1.0:1789428153.773389:0:23467:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789428153.773400:0:23467:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9196ade17800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428153.773468:0:23467:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958361dc00 x1876350940182272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789428153.773493:0:23467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789428153.773958:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940182272:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789428153.774021:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428153.774277:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940182272 00000100:00100000:1.0:1789428153.774289:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940182272 00000100:00100000:1.0:1789428153.774326:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789428153.774333:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1876350940182272:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789428153.774357:0:22718:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:1.0:1789428153.774387:0:22718:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x84fc867ede519e75 00000004:00100000:1.0:1789428153.774400:0:22718:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789428153.774449:0:22718:0:(import.c:65:import_set_state_nolock()) ffff9196905ed800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789428153.774498:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3612:x1876350940182272:12345-0@lo:38:llog_process_th.0 Request processed in 165us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.774506:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789428153.775067:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428153.775073:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789428153.775076:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428153.775092:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1789428153.775308:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91958361dc00 x1876350940182272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428153.775322:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789428153.775329:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789428153.775337:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789428153.775341:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789428153.775344:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196ade17800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789428153.775350:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3612:1876350940182272:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789428153.775732:0:23467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1789428153.775917:0:23448:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789428153.775953:0:23448:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789428153.775966:0:23448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583428600/0x84fc867ede519e59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e60 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.775978:0:23448:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583428600/0x84fc867ede519e59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e60 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789428153.776024:0:23448:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789428153.776026:0:23448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789428153.776028:0:23448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428153.776029:0:23448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428153.776031:0:23448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428153.776032:0:23448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428153.776034:0:23448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789428153.776036:0:23448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428153.776037:0:23448:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789428153.776041:0:23448:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1789428153.776043:0:23448:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789428153.776045:0:23448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789428153.776046:0:23448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428153.776047:0:23448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428153.776048:0:23448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428153.776050:0:23448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428153.776056:0:23448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789428153.776057:0:23448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428153.776058:0:23448:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789428153.776737:0:23448:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789428153.776758:0:23448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940182400:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789428153.776819:0:23448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789428153.777000:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428153.777029:0:23448:0:(client.c:2716:ptlrpc_set_wait()) set ffff919583fafcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789428153.777831:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940182400 00000100:00100000:0.0:1789428153.777840:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940182400 00000100:00100000:0.0:1789428153.778077:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789428153.778524:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+18:23448:x1876350940182400:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789428153.778558:0:22711:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789428153.778572:0:22711:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1789428153.781123:0:22696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789428153.781805:0:22711:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789428153.781855:0:22711:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1789428153.782203:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+18:23448:x1876350940182400:12345-0@lo:253:mount.lustre.0 Request processed in 3680us (5381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428153.782215:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789428153.782312:0:23448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:23448:1876350940182400:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789428153.782326:0:23448:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789428153.782329:0:23448:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789428153.782330:0:23448:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789428153.782332:0:23448:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789428153.782333:0:23448:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789428153.782334:0:23448:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789428153.782335:0:23448:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789428153.782336:0:23448:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789428153.782338:0:23448:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789428153.782339:0:23448:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789428153.782354:0:23448:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789428153.785991:0:22732:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789428153.786000:0:22732:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789428153.786025:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.786043:0:22732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583d1fc00/0x84fc867ede519d80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519d79 expref: 17 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.786051:0:22732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583d1ec00/0x84fc867ede519e44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519e3d expref: 17 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.786058:0:22732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.786111:0:22732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583d1ec00/0x84fc867ede519e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede519e3d expref: 17 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.786139:0:22732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583d1ec00/0x84fc867ede519e44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede519e3d expref: 17 pid: 22709 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428153.786154:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940182528:0@lo:104: 00000100:00100000:2.0:1789428153.786214:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789428153.786260:0:22732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583d1fc00/0x84fc867ede519d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede519d79 expref: 17 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.786268:0:22732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583d1fc00/0x84fc867ede519d80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede519d79 expref: 17 pid: 22711 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428153.786276:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940182656:0@lo:104: 00000100:00100000:2.0:1789428153.786297:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428153.786321:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adb309c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428153.786357:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940182528 00000100:00100000:2.0:1789428153.786364:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940182528 00000100:00100000:2.0:1789428153.786395:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940182656 00000100:00100000:2.0:1789428153.786399:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940182656 00000100:00100000:2.0:1789428153.786443:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428153.786454:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+4:22732:x1876350940182528:12345-0@lo:104: 00010000:00010000:2.0:1789428153.786467:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519e44 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.786519:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789428153.786526:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+4:22732:x1876350940182528:12345-0@lo:104: Request processed in 74us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428153.786533:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428153.786550:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789428153.786564:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+3:22732:x1876350940182656:12345-0@lo:104: 00010000:00010000:2.0:1789428153.786572:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519d80 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.786613:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789428153.786618:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+3:22732:x1876350940182656:12345-0@lo:104: Request processed in 56us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428153.786625:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1789428153.786770:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789428153.786778:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519e44 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.786786:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209600 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428153.786796:0:22705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519e44 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.786805:0:22705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519e44 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428153.786813:0:22705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519e44 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428153.786818:0:22705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789428153.786844:0:22705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519e44 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.786851:0:22705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789428153.786888:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940182528:0@lo:104: 00000100:00100000:2.0:1789428153.786900:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444d500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940182656:0@lo:104: 00010000:00010000:2.0:1789428153.786916:0:22732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1789428153.789210:0:23448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1789428153.789304:0:23472:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789428153.789309:0:23472:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00010000:00010000:0.0:1789428153.789764:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428153.790698:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519e44 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.790713:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519e3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519e44 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428153.790729:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428153.790731:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428153.790733:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428153.790787:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789428153.790809:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e871a47a-d8aa-4c92-86ef-047b0047c703:3613:1876350940182784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428153.790876:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428153.790930:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940182784 00000100:00100000:2.0:1789428153.790938:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940182784 00010000:00010000:2.0:1789428153.790968:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583d1ec00/0x84fc867ede519e44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519e3d expref: 18 pid: 22709 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428153.790995:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428153.791003:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+18:3613:x1876350940182784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428153.791016:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428153.791021:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583d1ec00/0x84fc867ede519e44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519e3d expref: 18 pid: 22709 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.791039:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583d1ec00/0x84fc867ede519e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede519e3d expref: 18 pid: 22709 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.791054:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1ec00/0x84fc867ede519e44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede519e3d expref: 18 pid: 22709 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428153.791067:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428153.791102:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+17:3613:x1876350940182784:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428153.791109:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428153.791149:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e871a47a-d8aa-4c92-86ef-047b0047c703:3613:1876350940182784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428153.795585:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428153.795591:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428153.795594:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428153.795632:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519d80 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.795646:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789428153.795650:0:22704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519d80 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.798756:0:22704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519d80 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789428153.798772:0:22704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519d80 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428153.798786:0:22704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789428153.798828:0:22704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519d80 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.798832:0:22704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789428153.798852:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519d80 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.798860:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519d79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519d80 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428153.798880:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428153.798883:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428153.798885:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428153.798914:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940182912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428153.798964:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428153.799011:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940182912 00000100:00100000:3.0:1789428153.799019:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940182912 00010000:00010000:3.0:1789428153.799049:0:22703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583d1fc00/0x84fc867ede519d80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519d79 expref: 17 pid: 22711 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428153.799076:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789428153.799232:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e871a47a-d8aa-4c92-86ef-047b0047c703+17:3615:x1876350940182912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428153.799258:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428153.799264:0:22703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583d1fc00/0x84fc867ede519d80 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519d79 expref: 17 pid: 22711 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.799285:0:22703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583d1fc00/0x84fc867ede519d80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede519d79 expref: 17 pid: 22711 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.799298:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1fc00/0x84fc867ede519d80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede519d79 expref: 17 pid: 22711 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.799445:0:22703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.799455:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789428153.799469:0:22703:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013470560s 00010000:00010000:3.0:1789428153.799474:0:22703:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.799481:0:22703:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.799488:0:22703:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.799494:0:22703:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.799499:0:22703:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428153.799504:0:22703:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.799511:0:22703:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.799731:0:22703:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.799743:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428153.799790:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e871a47a-d8aa-4c92-86ef-047b0047c703+16:3615:x1876350940182912:12345-0@lo:103:ldlm_bl.0 Request processed in 561us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428153.799798:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789428153.799830:0:22732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.799838:0:22732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428153.799843:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428800/0x84fc867ede519e7c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428153.799891:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940182912:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1789428153.803300:0:23474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789428153.803738:0:23448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1789428153.803993:0:23474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789428153.805011:0:23476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23476:1876350940183040:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789428153.805092:0:23476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428153.805127:0:23476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbcfa600 going to sleep for 11 seconds 00000100:00100000:1.0:1789428153.805183:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940183040 00000100:00100000:1.0:1789428153.805191:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940183040 00000100:00100000:1.0:1789428153.805235:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789428153.805245:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23476:x1876350940183040:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789428153.805333:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23476:x1876350940183040:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.805349:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:0.0:1789428153.805550:0:23448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1789428153.805587:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789428153.806099:0:23448:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789428153.806107:0:23448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1789428153.806147:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789428153.806880:0:23476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23476:1876350940183040:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1789428153.806916:0:23476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789428153.806954:0:23476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23476:1876350940183168:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789428153.807007:0:23476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428153.807041:0:23476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbcfa600 going to sleep for 11 seconds 00000100:00100000:1.0:1789428153.807497:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940183168 00000100:00100000:1.0:1789428153.807505:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940183168 00000100:00100000:1.0:1789428153.807554:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789428153.807563:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23476:x1876350940183168:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789428153.807833:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23476:x1876350940183168:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 271us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.807841:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789428153.807900:0:23476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23476:1876350940183168:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789428153.807972:0:23476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23476:1876350940183296:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789428153.808001:0:23476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428153.808023:0:23476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbcfae40 going to sleep for 11 seconds 00000040:00080000:0.0:1789428153.809241:0:23448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:1.0:1789428153.809815:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940183296 00000100:00100000:1.0:1789428153.809824:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940183296 00000100:00100000:1.0:1789428153.809862:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789428153.809871:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23476:x1876350940183296:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789428153.809954:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23476:x1876350940183296:12345-0@lo:900:lod0001_rec0000.0 Request processed in 85us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.809961:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789428153.810062:0:23476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9196bfa83100 x1876350940183296/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789428169 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428153.810075:0:23476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23476:1876350940183296:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789428153.810138:0:23476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23476:1876350940183424:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789428153.810171:0:23476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428153.810198:0:23476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbcfa600 going to sleep for 11 seconds 00000100:00100000:1.0:1789428153.810483:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940183424 00000100:00100000:1.0:1789428153.810488:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940183424 00000100:00100000:1.0:1789428153.810520:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789428153.810527:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23476:x1876350940183424:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789428153.810619:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23476:x1876350940183424:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 92us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428153.810625:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789428153.810744:0:23476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23476:1876350940183424:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1789428153.810784:0:23476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789428153.812074:0:23474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789428153.812147:0:23474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1789428153.812522:0:23448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789428153.812568:0:23448:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789428153.814011:0:23448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789428153.814563:0:23448:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000040:00080000:3.0:1789428153.816003:0:23476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789428153.816069:0:23476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789428153.816075:0:23476:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:0.0:1789428153.817868:0:23448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1789428153.819197:0:23448:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789428153.819228:0:23448:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb489c0d9b988 00100000:10000000:0.0:1789428153.819235:0:23448:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1789428153.820084:0:23448:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789428153.820110:0:23448:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789428153.820129:0:23448:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789428153.820143:0:23448:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1789428153.820970:0:23448:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789428153.821155:0:23448:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789428154.227256:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00010000:00010000:1.0:1789428154.800515:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789428154.801200:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789428154.993104:0:22713:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789428154.993116:0:22713:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919583218800 from 12 10000000:01000000:0.0:1789428154.993124:0:22713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789428154.993189:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428154.993204:0:22713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428154.993219:0:22713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428154.993254:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940183552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789428154.993353:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428154.993455:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ad8bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428154.994141:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940183552 00000100:00100000:2.0:1789428154.994153:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940183552 00000100:00100000:2.0:1789428154.994225:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789428154.994236:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+16:22713:x1876350940183552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428154.994261:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428154.994281:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583429400/0x84fc867ede519e8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519e83 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428154.994311:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429400/0x84fc867ede519e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519e83 expref: 17 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428154.994323:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583429400/0x84fc867ede519e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519e83 expref: 17 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428154.994356:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429400, rc 0) 00000100:00100000:2.0:1789428154.994524:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+17:22713:x1876350940183552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 289us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428154.994531:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789428154.994654:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940183552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428154.994675:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e8a expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428154.994686:0:22713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519e8a expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428154.994881:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940183680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789428154.994926:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428154.995213:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ad8bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428154.996041:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940183680 00000100:00100000:2.0:1789428154.996053:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940183680 00000100:00100000:2.0:1789428154.996168:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789428154.996179:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+17:22713:x1876350940183680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789428154.996205:0:22711:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789428154.996229:0:22711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789428154.996232:0:22711:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789428154.996359:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+17:22713:x1876350940183680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 182us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428154.996368:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789428154.996493:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940183680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789428154.996551:0:22713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789428154.996562:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e8a expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428154.996574:0:22713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e8a expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428154.996586:0:22713:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789428154.996589:0:22713:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196bbbf1000 from 12 10000000:01000000:0.0:1789428154.996603:0:22713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789428154.996638:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428154.996647:0:22713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428154.996656:0:22713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428154.996672:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940183808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789428154.996703:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428154.996733:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ad8bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428154.997026:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940183808 00000100:00100000:2.0:1789428154.997032:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940183808 00000100:00100000:2.0:1789428154.997056:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789428154.997064:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+17:22713:x1876350940183808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428154.997073:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428154.997086:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583429800/0x84fc867ede519e98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519e91 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428154.997107:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429800/0x84fc867ede519e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519e91 expref: 18 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428154.997116:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583429800/0x84fc867ede519e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519e91 expref: 18 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428154.997135:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429800, rc 0) 00000100:00100000:2.0:1789428154.997172:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+18:22713:x1876350940183808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428154.997178:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789428154.997250:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940183808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428154.997261:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e98 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428154.997270:0:22713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519e98 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428154.997313:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940183936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789428154.997340:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428154.997357:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ad8bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428154.997402:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940183936 00000100:00100000:2.0:1789428154.997406:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940183936 00000100:00100000:2.0:1789428154.997638:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789428154.997646:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+18:22713:x1876350940183936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789428154.997659:0:22711:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789428154.997673:0:22711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789428154.997676:0:22711:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1789428154.997750:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+18:22713:x1876350940183936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428154.997766:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789428154.997875:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940183936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789428154.997913:0:22713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789428154.997921:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e98 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428154.997930:0:22713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519e98 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789428155.249113:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789428155.249482:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00010000:00010000:3.0:1789428155.832461:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789428155.833055:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789428156.275750:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00010000:00010000:2.0:1789428156.848638:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789428157.148233:0:23718:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789428157.297080:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00010000:00010000:1.0:1789428157.872678:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789428157.951856:0:23770:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789428157.952024:0:23770:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789428158.320696:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 0 seconds 00000100:00100000:0.0:1789428158.768798:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940184064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789428158.768901:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428158.769038:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940184064 00000100:00100000:1.0:1789428158.769058:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940184064 00000100:00100000:1.0:1789428158.769127:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428158.769138:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940184064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789428158.769191:0:23457:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789428158.769251:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940184064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428158.769258:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789428158.769522:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940184064:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1789428158.785776:0:23820:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789428158.786741:0:23820:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789428158.897648:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789428159.280816:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:0.0:1789428159.280824:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1789428159.280827:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789428159.280834:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196bbb8e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789428159.280854:0:469:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9196bbb8e000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428159.280886:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfa81880 x1876350940184320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789428159.280921:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789428159.280922:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e871a47a-d8aa-4c92-86ef-047b0047c703:3614:1876350940184192:0@lo:400:kworker.0 00000100:00080000:3.0:1789428159.280929:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789428159.280934:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428159.280937:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789428159.280953:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428159.280956:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789428159.280959:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428159.280963:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789428159.281143:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428159.281207:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940184448:0@lo:400:kworker.0 00000100:00100000:0.0:1789428159.281239:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428159.281274:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940184320:0@lo:38:kworker.0 00000100:00100000:0.0:1789428159.281317:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428159.281351:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789428159.281360:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940184576:0@lo:400:kworker.0 00000100:00100000:0.0:1789428159.281388:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428159.281520:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940184320 00000100:00100000:3.0:1789428159.281531:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940184320 00000100:00100000:3.0:1789428159.281586:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789428159.281596:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3612:x1876350940184320:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789428159.281642:0:22722:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 503 last 0 00000020:00000080:3.0:1789428159.281686:0:22722:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede519e9f 00000004:00100000:3.0:1789428159.281709:0:22722:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789428159.281717:0:22722:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1789428159.281831:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940184448 00000100:00100000:3.0:1789428159.281836:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940184448 00000100:00100000:3.0:1789428159.281876:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940184576 00000100:00100000:3.0:1789428159.281879:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940184576 00000100:00100000:3.0:1789428159.281895:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789428159.281901:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940184448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428159.281967:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1876350940184448:12345-0@lo:400:kworker.0 Request processed in 66us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428159.281984:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789428159.282007:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789428159.282012:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940184576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428159.282045:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940184576:12345-0@lo:400:kworker.0 Request processed in 33us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428159.282050:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789428159.282081:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940184192 00000100:00100000:3.0:1789428159.282085:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940184192 00010000:00080000:0.0:1789428159.282098:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9196bfa80700 x1876350940184576/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428159.282117:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789428159.282118:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940184576:0@lo:400:kworker.0 00000100:00100000:3.0:1789428159.282131:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:3614:x1876350940184192:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789428159.282160:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9196bfa83480 x1876350940184448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428159.282172:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:3614:x1876350940184192:12345-0@lo:400:kworker.0 Request processed in 42us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428159.282175:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3614:1876350940184448:0@lo:400:kworker.0 00000100:00100000:3.0:1789428159.282185:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789428159.282194:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e871a47a-d8aa-4c92-86ef-047b0047c703:3614:1876350940184192:0@lo:400:kworker.0 00000100:00080000:3.0:1789428159.288311:0:22722:0:(import.c:65:import_set_state_nolock()) ffff9196bbbc5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428159.288488:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3612:x1876350940184320:12345-0@lo:38:kworker.0 Request processed in 6889us (7168us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428159.288502:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789428159.288641:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789428159.288656:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789428159.288664:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789428159.288667:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bbb8e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789428159.288694:0:3612:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007d40bf90): req@ffff91958361f480 x1876350940177280/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428159.291995:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940184704:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789428159.292099:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428159.292140:0:22758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428159.292170:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff919581085d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789428159.292204:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940184704 00000100:00100000:3.0:1789428159.292215:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940184704 00000100:00100000:3.0:1789428159.292279:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940177280 00000100:00100000:3.0:1789428159.292282:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940177280 00000100:00100000:3.0:1789428159.292300:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789428159.292310:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3616:x1876350940184704:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789428159.292362:0:23457:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789428159.292519:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940184320:0@lo:38:kworker.0 00000100:00100000:1.0:1789428159.292655:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789428159.292668:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22758:x1876350940177280:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789428159.292773:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22758:x1876350940177280:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 109us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428159.292781:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789428159.292865:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22758:1876350940177280:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1789428159.292907:0:22758:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789428159.292956:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22758:1876350940184832:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789428159.293151:0:22758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428159.293177:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ad8bb240 going to sleep for 11 seconds 00000100:00100000:1.0:1789428159.293274:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940184832 00000100:00100000:1.0:1789428159.293281:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940184832 00000100:00100000:1.0:1789428159.293307:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789428159.293314:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22758:x1876350940184832:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789428159.293497:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22758:x1876350940184832:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 183us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428159.293504:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789428159.293536:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22758:1876350940184832:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789428159.293629:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22758:1876350940184960:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789428159.293652:0:22758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428159.293671:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ad8bb240 going to sleep for 11 seconds 00000100:00100000:1.0:1789428159.293867:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940184960 00000100:00100000:1.0:1789428159.293873:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940184960 00000100:00100000:1.0:1789428159.293901:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789428159.293909:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22758:x1876350940184960:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1789428159.293970:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22758:x1876350940184960:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 61us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428159.293985:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789428159.294059:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22758:1876350940184960:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1789428159.294111:0:22758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789428159.296618:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940184704:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4286us (4498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428159.296661:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000040:00080000:0.0:1789428159.296836:0:22758:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789428159.297104:0:22758:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 17, retries 0 00000004:00080000:0.0:1789428159.297112:0:22758:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1789428159.300539:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940184704:0@lo:41:osp-pre-1-0.0 00000020:00000080:0.0:1789428159.711243:0:23869:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecd4944b0 20000000:00000080:0.0:1789428159.711270:0:23869:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9196a8a12c00 uarg=0000000000000000 20000000:01000000:0.0:1789428159.711331:0:23869:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789428159.711341:0:23869:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789428159.711348:0:23869:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789428159.715339:0:23870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1789428159.715807:0:23869:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789428159.724167:0:23869:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789428159.724200:0:23869:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428159.724220:0:23869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196c21e9400/0x84fc867ede519d4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519d48 expref: 17 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428159.724229:0:23869:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583d1ea00/0x84fc867ede519e52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519e4b expref: 17 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428159.724236:0:23869:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428159.724280:0:23869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583d1ea00/0x84fc867ede519e52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede519e4b expref: 17 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428159.724309:0:23869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583d1ea00/0x84fc867ede519e52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede519e4b expref: 17 pid: 22709 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428159.724325:0:23869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23869:1876350940185088:0@lo:104: 00000100:00100000:0.0:1789428159.724392:0:23869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428159.724469:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940185088 00000100:00100000:2.0:1789428159.724479:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940185088 00010000:00010000:0.0:1789428159.724487:0:23869:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196c21e9400/0x84fc867ede519d4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede519d48 expref: 17 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428159.724496:0:23869:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9196c21e9400/0x84fc867ede519d4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede519d48 expref: 17 pid: 22709 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428159.724506:0:23869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23869:1876350940185216:0@lo:104: 00000100:00100000:0.0:1789428159.724530:0:23869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428159.724706:0:23869:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ad8bb240 going to sleep for 11 seconds 00000100:00100000:2.0:1789428159.726300:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940185216 00000100:00100000:2.0:1789428159.726310:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940185216 00000100:00100000:2.0:1789428159.726361:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789428159.726370:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+4:23869:x1876350940185088:12345-0@lo:104: 00010000:00010000:2.0:1789428159.726386:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519e52 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428159.726482:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789428159.726490:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+4:23869:x1876350940185088:12345-0@lo:104: Request processed in 121us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428159.726499:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789428159.726499:0:23869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23869:1876350940185088:0@lo:104: 00000100:00100000:2.0:1789428159.727273:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428159.727286:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+3:23869:x1876350940185216:12345-0@lo:104: 00010000:00010000:2.0:1789428159.727298:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519d4f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428159.727365:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789428159.727371:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+3:23869:x1876350940185216:12345-0@lo:104: Request processed in 91us (2841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428159.727377:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1789428159.727399:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789428159.727405:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519e52 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428159.727432:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208c00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789428159.727437:0:22704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519e52 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428159.727446:0:22704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519e52 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789428159.727466:0:22704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519e52 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428159.727472:0:22704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789428159.727506:0:22704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519e52 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428159.727512:0:22704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789428159.727640:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428159.727648:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519d4f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.727758:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428159.727763:0:22705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519d4f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.727771:0:22705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519d4f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428159.727778:0:22705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519d4f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428159.727784:0:22705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789428159.727801:0:22705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519d4f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.727808:0:22705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789428159.727836:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519d4f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.727845:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519d48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519d4f expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.727859:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428159.727861:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428159.727863:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428159.727871:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789428159.727892:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e871a47a-d8aa-4c92-86ef-047b0047c703:3614:1876350940185472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428159.727930:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428159.727994:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940185472 00000100:00100000:1.0:1789428159.728000:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940185472 00010000:00010000:1.0:1789428159.728020:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196c21e9400/0x84fc867ede519d4f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519d48 expref: 18 pid: 22709 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428159.728043:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789428159.728050:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:3614:x1876350940185472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428159.728060:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428159.728066:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196c21e9400/0x84fc867ede519d4f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519d48 expref: 18 pid: 22709 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.728078:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196c21e9400/0x84fc867ede519d4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede519d48 expref: 18 pid: 22709 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.728098:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428159.728135:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:3614:x1876350940185472:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428159.728143:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789428159.728199:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e871a47a-d8aa-4c92-86ef-047b0047c703:3614:1876350940185472:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428159.728277:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519e52 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428159.728287:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208c00/0x84fc867ede519e4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519e52 expref: -99 pid: 23448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428159.728304:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e871a47a-d8aa-4c92-86ef-047b0047c703:3614:1876350940185344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428159.728305:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428159.728309:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428159.728314:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428159.728365:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428159.728741:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940185344 00000100:00100000:2.0:1789428159.728748:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940185344 00010000:00010000:2.0:1789428159.728767:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583d1ea00/0x84fc867ede519e52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519e4b expref: 18 pid: 22709 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428159.728802:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428159.728810:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+18:3614:x1876350940185344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428159.728819:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428159.728824:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583d1ea00/0x84fc867ede519e52 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519e4b expref: 18 pid: 22709 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428159.728834:0:23869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e9400/0x84fc867ede519d4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede519d48 expref: 18 pid: 22709 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428159.728836:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583d1ea00/0x84fc867ede519e52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede519e4b expref: 18 pid: 22709 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428159.728850:0:23869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23869:1876350940185216:0@lo:104: 00010000:00010000:2.0:1789428159.728857:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1ea00/0x84fc867ede519e52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede519e4b expref: 17 pid: 22709 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428159.728870:0:22701:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428159.729501:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428159.729525:0:23869:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.730637:0:22701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.730649:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.730664:0:22701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.730671:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.730688:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789428159.730692:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.730699:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.730725:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428159.730734:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428159.730799:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+16:3614:x1876350940185344:12345-0@lo:103:ldlm_bl.0 Request processed in 1989us (2433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428159.730808:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789428159.731213:0:23869:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428159.731225:0:23869:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428159.731244:0:23869:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208000/0x84fc867ede519ea6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23869 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428159.731315:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e871a47a-d8aa-4c92-86ef-047b0047c703:3614:1876350940185344:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428159.920791:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789428160.816619:0:22713:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789428160.816628:0:22713:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919583218800 from 13 10000000:01000000:1.0:1789428160.816633:0:22713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789428160.816758:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428160.816771:0:22713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428160.816783:0:22713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428160.816810:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940185600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789428160.816882:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428160.817673:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9000 going to sleep for 11 seconds 00000100:00100000:3.0:1789428160.820869:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940185600 00000100:00100000:3.0:1789428160.820884:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940185600 00000100:00100000:3.0:1789428160.821000:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789428160.821012:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+16:22713:x1876350940185600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789428160.821032:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428160.821054:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196c21e8c00/0x84fc867ede519eb4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519ead expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428160.821085:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196c21e8c00/0x84fc867ede519eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519ead expref: 17 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428160.821096:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196c21e8c00/0x84fc867ede519eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519ead expref: 17 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428160.821106:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196c21e8c00, rc 0) 00000100:00100000:3.0:1789428160.821197:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+17:22713:x1876350940185600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (4314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428160.821204:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789428160.821288:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940185600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428160.821306:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519eb4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428160.821317:0:22713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519eb4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428160.821407:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940185728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428160.821478:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428160.826060:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834bec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789428160.827715:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940185728 00000100:00100000:0.0:1789428160.827729:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940185728 00000100:00100000:0.0:1789428160.827785:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789428160.827795:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+17:22713:x1876350940185728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428160.827980:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+17:22713:x1876350940185728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (6500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428160.827989:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789428160.828079:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940185728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428160.828137:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940185856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789428160.828186:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428160.828214:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ad8bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789428160.828227:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940185856 00000100:00100000:0.0:1789428160.828231:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940185856 00000100:00100000:0.0:1789428160.828249:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789428160.828256:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+17:22713:x1876350940185856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789428160.828329:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+17:22713:x1876350940185856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428160.828336:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789428160.828379:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940185856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789428160.831598:0:23934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789428160.831788:0:22713:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789428160.831812:0:22713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789428160.831825:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519eb4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428160.831836:0:22713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519eb4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428160.831846:0:22713:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789428160.831848:0:22713:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bbbf1000 from 13 10000000:01000000:1.0:1789428160.831851:0:22713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789428160.831897:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428160.831905:0:22713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428160.831915:0:22713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428160.831942:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940185984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789428160.832017:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428160.832057:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789428160.832078:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940185984 00000100:00100000:1.0:1789428160.832085:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940185984 00000100:00100000:1.0:1789428160.832131:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789428160.832140:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+17:22713:x1876350940185984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428160.832153:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428160.832165:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1e200/0x84fc867ede519ec2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519ebb expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428160.832200:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1e200/0x84fc867ede519ec2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519ebb expref: 18 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428160.832211:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1e200/0x84fc867ede519ec2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519ebb expref: 18 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428160.832219:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e200, rc 0) 00000100:00100000:1.0:1789428160.832256:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:22713:x1876350940185984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428160.832262:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789428160.832312:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940185984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428160.832326:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519ec2 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428160.832335:0:22713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519ec2 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428160.832388:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940186112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789428160.832435:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428160.832452:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789428160.832464:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940186112 00000100:00100000:1.0:1789428160.832468:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940186112 00000100:00100000:1.0:1789428160.832489:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789428160.832495:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+18:22713:x1876350940186112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789428160.834757:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+18:22713:x1876350940186112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2254us (2335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428160.834779:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789428160.834791:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940186112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789428160.834843:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940186240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789428160.834905:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428160.834936:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789428160.835028:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940186240 00000100:00100000:1.0:1789428160.835035:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940186240 00000100:00100000:1.0:1789428160.835108:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789428160.835119:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+18:22713:x1876350940186240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789428160.835213:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+18:22713:x1876350940186240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428160.835220:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789428160.835233:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa80380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940186240:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789428160.836003:0:23936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789428160.836051:0:22713:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789428160.836074:0:22713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789428160.836085:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519ec2 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428160.836097:0:22713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519ec2 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428160.945404:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428161.970083:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428162.992986:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428163.378608:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428153/real 1789428153] req@ffff91958361e680 x1876350940180480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428163 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428163.378662:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91958361e680 x1876350940180480/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428163 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428163.378672:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428153/real 1789428153] req@ffff91958361ca80 x1876350940180224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428163 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428163.378684:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91958361ca80 x1876350940180224/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428163 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789428163.378703:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919692afd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428163.378848:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789428163.378853:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940180480:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789428163.378860:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bc9e4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789428163.378866:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789428163.378868:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940180224:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789428163.379154:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428163.379159:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789428163.379161:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428163.379164:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789428163.379184:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428163.379188:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789428163.379191:0:37:0:(import.c:65:import_set_state_nolock()) ffff9196bc9e4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789428163.379196:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 498 00000100:00080000:3.0:1789428163.379202:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789428163.379212:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9196bc9e4000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428163.379231:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfa82680 x1876350940186880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789428163.379245:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428163.379248:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789428163.379249:0:37:0:(import.c:65:import_set_state_nolock()) ffff919692afd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789428163.379252:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 498 00000100:00080000:3.0:1789428163.379262:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789428163.379267:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff919692afd000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428163.379278:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfa82d80 x1876350940187008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789428163.379319:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940186496:0@lo:400:kworker.0 00000100:00100000:3.0:1789428163.379383:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428163.379589:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940186368:0@lo:400:kworker.0 00000100:00100000:1.0:1789428163.379637:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428163.379663:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940187136:0@lo:400:kworker.0 00000100:00100000:1.0:1789428163.379693:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428163.379727:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940186496 00000100:00100000:1.0:1789428163.379735:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940186496 00000100:00100000:1.0:1789428163.379781:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789428163.379789:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940186496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428163.379836:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1876350940186496:12345-0@lo:400:kworker.0 Request processed in 48us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428163.379843:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789428163.379869:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940186368 00000100:00100000:1.0:1789428163.379873:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940186368 00000100:00100000:1.0:1789428163.379895:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789428163.379901:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:3615:x1876350940186368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428163.379931:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:3615:x1876350940186368:12345-0@lo:400:kworker.0 Request processed in 30us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428163.379945:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940186368:0@lo:400:kworker.0 00000100:00100000:1.0:1789428163.379947:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789428163.379973:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940187136 00000100:00100000:1.0:1789428163.379977:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940187136 00000100:00100000:1.0:1789428163.380007:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789428163.380013:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940187136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428163.380046:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940187136:12345-0@lo:400:kworker.0 Request processed in 34us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428163.380051:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789428163.380078:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9196bfa81180 x1876350940187136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428163.380088:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940187136:0@lo:400:kworker.0 00000100:00100000:3.0:1789428163.380809:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940186496:0@lo:400:kworker.0 00000100:00100000:3.0:1789428163.380831:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940186624:0@lo:400:kworker.0 00000100:00100000:3.0:1789428163.380868:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428163.380895:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789428163.380901:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940186752:0@lo:400:kworker.0 00000100:00100000:3.0:1789428163.380920:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428163.380951:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940186752 00000100:00100000:3.0:1789428163.380955:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940186752 00000100:00100000:3.0:1789428163.380977:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789428163.380983:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940186752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428163.381017:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940186752:12345-0@lo:400:kworker.0 Request processed in 34us (96us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428163.381022:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789428163.381046:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940186752:0@lo:400:kworker.0 00000100:00100000:3.0:1789428163.381062:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940186880:0@lo:8:kworker.0 00000400:00000100:3.0:1789428163.381083:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940186880 offset 0 length 520: 4 00000100:00100000:3.0:1789428163.381100:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940187008:0@lo:8:kworker.0 00000400:00000100:3.0:1789428163.381114:0:3612:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876350940187008 offset 0 length 520: 4 00000100:00100000:1.0:1789428163.381571:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940186624 00000100:00100000:1.0:1789428163.381577:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940186624 00000100:00100000:1.0:1789428163.381613:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789428163.381635:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940186624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428163.381692:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940186624:12345-0@lo:400:kworker.0 Request processed in 73us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428163.381699:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789428163.381817:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9196bfa82a00 x1876350940186624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428163.381827:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940186624:0@lo:400:kworker.0 00000100:00100000:0.0:1789428163.888840:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789428163.895775:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940187264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789428163.895855:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428163.895912:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940187264 00000100:00100000:3.0:1789428163.895922:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940187264 00000100:00100000:3.0:1789428163.895977:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789428163.895987:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940187264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789428163.896024:0:23457:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789428163.896085:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940187264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428163.896092:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789428163.896188:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940187264:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789428164.016561:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428164.401600:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940187392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789428164.401694:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428164.401974:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940187392 00000100:00100000:2.0:1789428164.401982:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940187392 00000100:00100000:2.0:1789428164.402056:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789428164.402065:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940187392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789428164.402098:0:22722:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789428164.402149:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3613:x1876350940187392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428164.402156:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789428164.402221:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940187392:0@lo:41:osp-pre-1-0.0 00000020:01000004:2.0:1789428164.876031:0:24216:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789428164.876036:0:24216:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789428164.876038:0:24216:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789428164.876149:0:24216:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9196bcc8e800 00000020:01000004:2.0:1789428164.876163:0:24216:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789428164.876177:0:24216:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789428164.876190:0:24216:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff919581dd8000) 00000020:00000080:2.0:1789428164.876206:0:24216:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789428164.913019:0:24216:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789428164.915516:0:24216:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789428164.915819:0:24216:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789428164.916005:0:24216:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789428164.916381:0:24216:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789428164.916817:0:24216:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789428164.917010:0:24216:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1789428164.917793:0:24216:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789428164.917990:0:24216:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789428164.918004:0:24216:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789428164.918014:0:24216:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x84fc867ede519ed0 00000020:01000004:2.0:1789428164.918020:0:24216:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789428164.918041:0:24216:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.124@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789428164.918045:0:24216:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789428164.918058:0:24216:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789428164.918064:0:24216:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789428164.918076:0:24216:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9196888a99c0) 00000020:00000080:2.0:1789428164.918087:0:24216:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789428164.919246:0:24216:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428164.919394:0:24216:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789428164.919400:0:24216:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789428164.920180:0:24216:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789428164.920187:0:24216:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789428164.920544:0:24216:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789428164.920550:0:24216:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789428164.923006:0:24216:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428164.923179:0:24216:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789428164.923186:0:24216:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789428164.927702:0:24216:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789428164.927716:0:24216:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789428164.945915:0:24216:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428164.946163:0:24216:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789428164.946170:0:24216:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789428164.947407:0:24216:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789428164.947746:0:24216:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789428164.948897:0:24216:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789428164.948908:0:24216:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789428164.951160:0:24216:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789428164.951360:0:24216:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789428164.951367:0:24216:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789428164.952219:0:24216:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789428164.952228:0:24216:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789428164.981734:0:24216:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789428164.981950:0:24216:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789428164.981957:0:24216:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789428164.983163:0:24216:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789428164.983173:0:24216:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789428164.983757:0:24216:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789428164.983784:0:24216:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789428164.983790:0:24216:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789428164.992901:0:24216:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789428164.992950:0:24216:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.124@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789428164.992955:0:24216:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789428164.992957:0:24216:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789428164.992959:0:24216:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428164.992965:0:24216:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428164.992966:0:24216:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428164.992968:0:24216:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428164.992970:0:24216:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428164.992971:0:24216:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428164.992973:0:24216:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789428164.992977:0:24216:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789428164.992979:0:24216:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789428164.992980:0:24216:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789428164.992981:0:24216:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428164.992982:0:24216:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428164.992983:0:24216:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428164.992985:0:24216:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428164.992986:0:24216:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428164.992987:0:24216:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428164.992988:0:24216:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789428164.993014:0:24216:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789428164.993035:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa82300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940187520:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789428164.993105:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428164.993212:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ad8bb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428164.993261:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940187520 00000100:00100000:1.0:1789428164.993269:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940187520 00000100:00100000:1.0:1789428164.993382:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789428164.993392:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+18:24216:x1876350940187520:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789428164.993451:0:22709:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789428164.993461:0:22709:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789428164.993465:0:22709:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789428164.993807:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+18:24216:x1876350940187520:12345-0@lo:253:mount.lustre.0 Request processed in 416us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428164.993816:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789428164.993963:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa82300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940187520:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789428164.993981:0:24216:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789428164.993984:0:24216:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789428164.993985:0:24216:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789428164.993987:0:24216:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428164.993988:0:24216:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428164.993989:0:24216:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428164.993990:0:24216:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428164.993991:0:24216:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789428164.993993:0:24216:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428164.993994:0:24216:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789428164.994012:0:24216:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9196bcc8e800 from lustre-OST0000 10000000:01000000:0.0:1789428164.994042:0:24216:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789428164.994045:0:24216:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789428164.994053:0:24216:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff919688450000 local copy 00010000:00010000:0.0:1789428164.994063:0:24216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519c92 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428164.994142:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940187648:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428164.994174:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428164.994280:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789428164.994343:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940187648 00000100:00100000:2.0:1789428164.994348:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940187648 00000100:00100000:2.0:1789428164.994376:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789428164.994384:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968290ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:24216:x1876350940187648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428164.994479:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968290ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:24216:x1876350940187648:12345-0@lo:501:mount.lustre.0 Request processed in 96us (304us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789428164.994487:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789428164.994587:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940187648:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789428164.994600:0:24216:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789428164.994617:0:24216:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789428164.994622:0:24216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519c92 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428164.994632:0:24216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519c92 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428164.994654:0:24216:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9196bcc8e800 10000000:01000000:0.0:1789428164.994664:0:24216:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789428164.994670:0:24216:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789428164.994673:0:24216:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789428164.994676:0:24216:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789428164.994679:0:24216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789428164.994700:0:24216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428164.994708:0:24216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428164.994717:0:24216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519ede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428164.994729:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940187776:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789428164.994756:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428164.994780:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789428164.994834:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940187776 00000100:00100000:2.0:1789428164.994845:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940187776 00000100:00100000:2.0:1789428164.994865:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789428164.994872:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968290e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+18:24216:x1876350940187776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428164.994880:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428164.994891:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583428c00/0x84fc867ede519ee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519ede expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428164.994912:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428c00/0x84fc867ede519ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519ede expref: 19 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428164.994922:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583428c00/0x84fc867ede519ee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519ede expref: 19 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428164.994930:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428c00, rc 0) 00000100:00100000:2.0:1789428164.994968:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968290e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+19:24216:x1876350940187776:12345-0@lo:101:mount.lustre.0 Request processed in 96us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428164.994974:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789428164.995041:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940187776:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428164.995053:0:24216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519ede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519ee5 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428164.995061:0:24216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519ede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519ee5 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789428164.996138:0:24216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1789428164.996748:0:24216:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789428165.001941:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789428165.002003:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1789428165.002022:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1789428165.002036:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1789428165.002062:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1789428165.002074:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1789428165.002087:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1789428165.002100:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1789428165.002112:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:0.0:1789428165.002125:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:0.0:1789428165.002136:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:0.0:1789428165.002147:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:0.0:1789428165.002188:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:0.0:1789428165.002195:0:24216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:0.0:1789428165.002320:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940187904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428165.002390:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428165.002458:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9000 going to sleep for 11 seconds 00000100:00100000:2.0:1789428165.002595:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940187904 00000100:00100000:2.0:1789428165.002604:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940187904 00000100:00100000:2.0:1789428165.002649:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789428165.002658:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+19:24216:x1876350940187904:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428165.002800:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+19:24216:x1876350940187904:12345-0@lo:501:mount.lustre.0 Request processed in 142us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428165.002807:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789428165.002911:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940187904:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428165.002949:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188032:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428165.002987:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428165.003022:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9000 going to sleep for 11 seconds 00000100:00100000:1.0:1789428165.003156:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940188032 00000100:00100000:1.0:1789428165.003161:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940188032 00000100:00100000:1.0:1789428165.003195:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789428165.003202:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+19:24216:x1876350940188032:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789428165.003942:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+19:24216:x1876350940188032:12345-0@lo:503:mount.lustre.0 Request processed in 739us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428165.003951:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789428165.004075:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188032:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789428165.004491:0:24216:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789428165.004637:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188160:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428165.004682:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428165.004707:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789428165.004772:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940188160 00000100:00100000:1.0:1789428165.004779:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940188160 00000100:00100000:1.0:1789428165.004818:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789428165.004826:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+19:24216:x1876350940188160:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428165.005240:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+19:24216:x1876350940188160:12345-0@lo:502:mount.lustre.0 Request processed in 414us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428165.005248:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789428165.005338:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188160:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789428165.005542:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789428165.005660:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:0.0:1789428165.005675:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:0.0:1789428165.005685:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:0.0:1789428165.005712:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:0.0:1789428165.005724:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:0.0:1789428165.005734:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:0.0:1789428165.005747:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:0.0:1789428165.005761:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:0.0:1789428165.005772:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:0.0:1789428165.005782:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:0.0:1789428165.005792:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:0.0:1789428165.005816:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188288:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428165.005853:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428165.006076:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789428165.006151:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940188288 00000100:00100000:1.0:1789428165.006156:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940188288 00000100:00100000:1.0:1789428165.006223:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789428165.006231:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+19:24216:x1876350940188288:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428165.006342:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+19:24216:x1876350940188288:12345-0@lo:502:mount.lustre.0 Request processed in 112us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428165.006350:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789428165.006444:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188288:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789428165.006485:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:0.0:1789428165.006493:0:24216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789428165.007151:0:24233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789428165.007159:0:24233:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789428165.007166:0:24233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.007169:0:24233:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789428165.007174:0:24233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789428165.007192:0:24233:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9196888acd40) 00000020:00000080:2.0:1789428165.007213:0:24233:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789428165.007220:0:24233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789428165.007311:0:24233:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bcc8e800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789428165.007319:0:24233:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789428165.007326:0:24233:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x84fc867ede519ef3 00010000:00010000:2.0:1789428165.011273:0:24233:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1789428165.011910:0:24233:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1789428165.013203:0:24233:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1789428165.014382:0:24233:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789428165.014394:0:24233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789428165.014400:0:24233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789428165.014402:0:24233:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789428165.014406:0:24233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789428165.014408:0:24233:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1789428165.014410:0:24233:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789428165.014411:0:24233:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789428165.014492:0:24233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789428165.016453:0:24233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.016460:0:24233:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789428165.016469:0:24233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428165.016475:0:24233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.016476:0:24233:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789428165.016480:0:24233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789428165.016482:0:24233:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789428165.016485:0:24233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428165.016487:0:24233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.016489:0:24233:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789428165.016491:0:24233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428165.016493:0:24233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.016494:0:24233:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789428165.016498:0:24233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789428165.016548:0:24233:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428165.016550:0:24233:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.016551:0:24233:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789428165.016555:0:24233:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1789428165.016755:0:24216:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789428165.016785:0:24216:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789428165.016807:0:24216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519ede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519ee5 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428165.016819:0:24216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209600/0x84fc867ede519ede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519ee5 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428165.016827:0:24216:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bcc8e800 from 1 10000000:01000000:0.0:1789428165.016830:0:24216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789428165.016869:0:24216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428165.016877:0:24216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428165.016901:0:24216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428165.016924:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188416:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789428165.016991:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428165.017028:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9000 going to sleep for 11 seconds 00000100:00100000:1.0:1789428165.017187:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940188416 00000100:00100000:1.0:1789428165.017201:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940188416 00000100:00100000:1.0:1789428165.017254:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789428165.017263:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+19:24216:x1876350940188416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428165.017276:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428165.017287:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1e400/0x84fc867ede519f01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519efa expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428165.017309:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1e400/0x84fc867ede519f01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519efa expref: 20 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428165.017320:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1e400/0x84fc867ede519f01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519efa expref: 20 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428165.017328:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e400, rc 0) 00000100:00100000:1.0:1789428165.017478:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+20:24216:x1876350940188416:12345-0@lo:101:mount.lustre.0 Request processed in 216us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428165.017485:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789428165.020030:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188416:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428165.020058:0:24216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519f01 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428165.020071:0:24216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519f01 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789428165.021255:0:24216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1789428165.021553:0:24216:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789428165.021757:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789428165.021785:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789428165.021800:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789428165.021815:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789428165.021830:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789428165.021844:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789428165.021857:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789428165.021871:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1789428165.021891:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1789428165.021906:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1789428165.021920:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1789428165.021938:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1789428165.021943:0:24216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1789428165.022016:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428165.022089:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428165.022131:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789428165.022456:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940188544 00000100:00100000:3.0:1789428165.022464:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940188544 00000100:00100000:3.0:1789428165.022542:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789428165.022551:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+20:24216:x1876350940188544:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428165.022676:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+20:24216:x1876350940188544:12345-0@lo:501:mount.lustre.0 Request processed in 124us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428165.022695:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789428165.022908:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188544:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428165.022945:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188672:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428165.022984:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428165.023049:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789428165.025475:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940188672 00000100:00100000:2.0:1789428165.025487:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940188672 00000100:00100000:2.0:1789428165.025550:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789428165.025657:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+20:24216:x1876350940188672:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789428165.025872:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+20:24216:x1876350940188672:12345-0@lo:503:mount.lustre.0 Request processed in 314us (2887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428165.025890:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789428165.026072:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188672:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789428165.026843:0:24216:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789428165.026947:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188800:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428165.027003:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428165.027120:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687c3b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428165.027160:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940188800 00000100:00100000:3.0:1789428165.027166:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940188800 00000100:00100000:3.0:1789428165.027209:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789428165.027218:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+20:24216:x1876350940188800:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428165.027394:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+20:24216:x1876350940188800:12345-0@lo:502:mount.lustre.0 Request processed in 176us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428165.027402:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789428165.027732:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188800:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789428165.028029:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1789428165.028057:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1789428165.028072:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1789428165.028084:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1789428165.028094:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1789428165.028103:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1789428165.028112:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1789428165.028135:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1789428165.028146:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1789428165.028156:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1789428165.028165:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1789428165.028186:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428165.028223:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428165.028284:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687c3b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428165.028315:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940188928 00000100:00100000:3.0:1789428165.028321:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940188928 00000100:00100000:3.0:1789428165.028376:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789428165.028383:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+20:24216:x1876350940188928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428165.028693:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+20:24216:x1876350940188928:12345-0@lo:502:mount.lustre.0 Request processed in 309us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428165.028700:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789428165.028765:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940188928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789428165.028812:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1789428165.028820:0:24216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789428165.029440:0:24237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428165.029450:0:24237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.029453:0:24237:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789428165.029459:0:24237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196bcc8e800 00000020:00000080:2.0:1789428165.029462:0:24237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789428165.029469:0:24237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428165.029472:0:24237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.029474:0:24237:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789428165.029476:0:24237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428165.029479:0:24237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.029480:0:24237:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789428165.029483:0:24237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9196bcc8e800 00000020:00000080:2.0:1789428165.029485:0:24237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789428165.029554:0:24237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428165.029567:0:24237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.029568:0:24237:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789428165.029571:0:24237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428165.029574:0:24237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.029575:0:24237:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789428165.029578:0:24237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196bcc8e800 00000020:00000080:2.0:1789428165.029581:0:24237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789428165.029599:0:24237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428165.029602:0:24237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.029603:0:24237:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789428165.029606:0:24237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789428165.029608:0:24237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.029610:0:24237:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789428165.029621:0:24237:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9196bcc8e800 00000020:00000080:2.0:1789428165.029623:0:24237:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789428165.029647:0:24237:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789428165.029650:0:24237:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789428165.029652:0:24237:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789428165.029654:0:24237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1789428165.029748:0:24216:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789428165.029770:0:24216:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789428165.029786:0:24216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519f01 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.029798:0:24216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519f01 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428165.029857:0:24216:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789428165.029860:0:24216:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9196bcc8e800 10000000:01000000:2.0:1789428165.029863:0:24216:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9196bcc8e800 10000000:01000000:2.0:1789428165.029867:0:24216:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789428165.029873:0:24216:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9196bcc8e800 from 1 10000000:01000000:2.0:1789428165.029876:0:24216:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789428165.029906:0:24216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583428400/0x84fc867ede519f08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.029915:0:24216:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583428400/0x84fc867ede519f08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.029925:0:24216:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583428400/0x84fc867ede519f08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428165.029944:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940189056:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789428165.029995:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428165.034376:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698a01480 going to sleep for 11 seconds 00000100:00100000:3.0:1789428165.038397:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940189056 00000100:00100000:3.0:1789428165.038496:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940189056 00000100:00100000:1.0:1789428165.038564:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789428165.038578:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+20:24216:x1876350940189056:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428165.038597:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428165.038615:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1f400/0x84fc867ede519f0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519f08 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428165.038641:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1f400/0x84fc867ede519f0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519f08 expref: 21 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428165.038652:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1f400/0x84fc867ede519f0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519f08 expref: 21 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428165.038660:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f400, rc 0) 00000100:00100000:1.0:1789428165.038807:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+21:24216:x1876350940189056:12345-0@lo:101:mount.lustre.0 Request processed in 233us (8812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428165.038814:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789428165.039680:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940189056:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428165.039699:0:24216:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583428400/0x84fc867ede519f08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519f0f expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.039709:0:24216:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583428400/0x84fc867ede519f08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519f0f expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428165.041247:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789428165.042142:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789428165.042539:0:24216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1789428165.042879:0:24216:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789428165.043073:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1789428165.043098:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1789428165.043111:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1789428165.043124:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1789428165.043135:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1789428165.043145:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1789428165.043156:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1789428165.043167:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1789428165.043179:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1789428165.043191:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1789428165.043203:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1789428165.043215:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1789428165.043227:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1789428165.043252:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1789428165.043267:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1789428165.043280:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1789428165.043293:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1789428165.043306:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1789428165.043318:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1789428165.043330:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1789428165.043342:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1789428165.043355:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1789428165.043378:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1789428165.043393:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1789428165.043406:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1789428165.044101:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1789428165.044123:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1789428165.044137:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1789428165.044150:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1789428165.044179:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1789428165.044194:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1789428165.044207:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1789428165.044219:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1789428165.044232:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1789428165.044244:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1789428165.044256:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1789428165.044267:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1789428165.044279:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1789428165.044292:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1789428165.044304:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1789428165.044316:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1789428165.044327:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1789428165.044337:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1789428165.044347:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1789428165.044359:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1789428165.044389:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1789428165.044406:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1789428165.045638:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1789428165.045800:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1789428165.045821:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1789428165.045838:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1789428165.045844:0:24216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1789428165.045941:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940189184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428165.046010:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428165.046066:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698a01cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789428165.046166:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940189184 00000100:00100000:0.0:1789428165.046173:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940189184 00000100:00100000:0.0:1789428165.046223:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789428165.046232:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+21:24216:x1876350940189184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428165.046351:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+21:24216:x1876350940189184:12345-0@lo:501:mount.lustre.0 Request processed in 120us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428165.046358:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789428165.046674:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940189184:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428165.046709:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940189312:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789428165.046747:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428165.046807:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698a01cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789428165.049664:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940189312 00000100:00100000:0.0:1789428165.049676:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940189312 00000100:00100000:0.0:1789428165.049724:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789428165.049733:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+21:24216:x1876350940189312:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428165.049920:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+21:24216:x1876350940189312:12345-0@lo:503:mount.lustre.0 Request processed in 187us (3172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428165.049929:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789428165.050633:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940189312:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789428165.051021:0:24216:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789428165.051090:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940189440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428165.051139:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428165.051173:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940189440 00000100:00100000:2.0:1789428165.051177:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940189440 00000100:00100000:2.0:1789428165.052674:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789428165.052690:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+21:24216:x1876350940189440:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428165.052832:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+21:24216:x1876350940189440:12345-0@lo:502:mount.lustre.0 Request processed in 147us (1692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428165.052840:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789428165.053137:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698a01480 going to sleep for 11 seconds 00000100:00100000:2.0:1789428165.053162:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940189440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789428165.053361:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789428165.053390:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1789428165.053404:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1789428165.053717:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1789428165.053736:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1789428165.053751:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1789428165.053765:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1789428165.053779:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1789428165.053812:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789428165.053825:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1789428165.053835:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1789428165.053845:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1789428165.053854:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1789428165.053864:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1789428165.053874:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1789428165.053883:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1789428165.053892:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1789428165.053904:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1789428165.053915:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1789428165.053926:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1789428165.053935:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1789428165.053945:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1789428165.053954:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1789428165.053965:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1789428165.053989:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1789428165.054004:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1789428165.054016:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1789428165.054027:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1789428165.054039:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1789428165.054052:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1789428165.054065:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1789428165.054078:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1789428165.054092:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1789428165.054105:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1789428165.054118:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1789428165.054133:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1789428165.054146:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1789428165.054161:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1789428165.054172:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1789428165.054189:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1789428165.054216:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1789428165.054242:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1789428165.054255:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1789428165.054269:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1789428165.054282:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1789428165.054296:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1789428165.054309:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1789428165.054323:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1789428165.054368:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940189568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428165.054632:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428165.054707:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698a01480 going to sleep for 11 seconds 00000100:00100000:0.0:1789428165.054751:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940189568 00000100:00100000:0.0:1789428165.054759:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940189568 00000100:00100000:0.0:1789428165.054839:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789428165.054848:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+21:24216:x1876350940189568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428165.054954:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+21:24216:x1876350940189568:12345-0@lo:502:mount.lustre.0 Request processed in 107us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428165.054961:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789428165.056589:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940189568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789428165.056784:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1789428165.056813:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1789428165.056847:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940189696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428165.056903:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428165.056932:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698a01480 going to sleep for 11 seconds 00000100:00100000:2.0:1789428165.056951:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940189696 00000100:00100000:2.0:1789428165.056956:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940189696 00000100:00100000:2.0:1789428165.056990:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789428165.056998:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+21:24216:x1876350940189696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428165.057086:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+21:24216:x1876350940189696:12345-0@lo:502:mount.lustre.0 Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428165.057093:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789428165.057135:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940189696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789428165.057168:0:24216:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1789428165.057176:0:24216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789428165.060889:0:24242:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789428165.060906:0:24242:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9196bbde4d40) 00000020:00000080:1.0:1789428165.060929:0:24242:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789428165.061029:0:24242:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bcc8e800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789428165.061033:0:24242:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196bcc8e800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789428165.061036:0:24242:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bcc8e800 3 00010000:00080000:1.0:1789428165.061078:0:24242:0:(ldlm_lib.c:102:import_set_conn()) imp ffff919583041000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.124@tcp at head 00010000:00010000:0.0:1789428165.063001:0:24242:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1789428165.063199:0:24242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789428165.063241:0:24242:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789428165.063254:0:24242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x84fc867ede519f1d 00000100:00080000:0.0:1789428165.063263:0:24242:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789428165.063273:0:24242:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff919583041000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428165.063306:0:24242:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfb8ce00 x1876350940189824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428165.063330:0:24242:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:0.0:1789428165.064660:0:24242:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789428165.064673:0:24242:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9196bf98b380) 00000020:00000080:0.0:1789428165.064691:0:24242:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1789428165.064758:0:24242:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9196bcc8e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789428165.064762:0:24242:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9196bcc8e800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789428165.064765:0:24242:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9196bcc8e800 3 00010000:00080000:0.0:1789428165.064792:0:24242:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196bc9e3000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.124@tcp at head 00000100:00100000:3.0:1789428165.068652:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940189824:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789428165.068734:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789428165.068838:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428165.068842:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789428165.068845:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428165.068847:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789428165.068852:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940189824 00000100:00100000:1.0:1789428165.068861:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940189824 00000100:00080000:3.0:1789428165.068870:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428165.068879:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789428165.068881:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428165.068884:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789428165.068891:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789428165.068897:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1876350940189824:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789428165.068910:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940189952:0@lo:400:kworker.0 00010000:00080000:1.0:1789428165.068921:0:22716:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000100:00100000:3.0:1789428165.068940:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428165.068961:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789428165.068967:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940190336:0@lo:400:kworker.0 00000020:00000080:1.0:1789428165.068970:0:22716:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x84fc867ede519f2b 00000004:00100000:1.0:1789428165.068985:0:22716:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:3.0:1789428165.068986:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789428165.069016:0:22716:0:(import.c:65:import_set_state_nolock()) ffff919583046800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789428165.069067:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3612:x1876350940189824:12345-0@lo:38:llog_process_th.0 Request processed in 168us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428165.069074:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789428165.069089:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940190336 00000100:00100000:1.0:1789428165.069092:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940190336 00000100:00100000:1.0:1789428165.069111:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789428165.069116:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940190336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428165.069148:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1876350940190336:12345-0@lo:400:kworker.0 Request processed in 32us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428165.069153:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789428165.070547:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940189952 00000100:00100000:1.0:1789428165.070557:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940189952 00000100:00100000:1.0:1789428165.070605:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789428165.070614:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940189952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428165.070681:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940189952:12345-0@lo:400:kworker.0 Request processed in 69us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428165.070688:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789428165.070718:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940190208:0@lo:400:kworker.0 00000100:00100000:1.0:1789428165.070767:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428165.070797:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789428165.070802:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940190080:0@lo:400:kworker.0 00000100:00100000:1.0:1789428165.070822:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428165.070851:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940190080 00000100:00100000:1.0:1789428165.070855:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940190080 00000100:00100000:1.0:1789428165.070888:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789428165.070893:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940190080:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789428165.070922:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bfb8ce00 x1876350940189824/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428165.070924:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940190080:12345-0@lo:400:kworker.0 Request processed in 31us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428165.070935:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:1.0:1789428165.070941:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789428165.070944:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1789428165.070952:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789428165.070957:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789428165.070960:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919583041000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789428165.070966:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3612:1876350940189824:0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789428165.070968:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bfa83100 x1876350940190080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428165.070976:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940190080:0@lo:400:kworker.0 00010000:00080000:3.0:1789428165.070997:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bfa80700 x1876350940190336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428165.071006:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3614:1876350940190336:0@lo:400:kworker.0 00000100:00100000:3.0:1789428165.071017:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940189952:0@lo:400:kworker.0 00000100:00100000:2.0:1789428165.071521:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940190208 00000100:00100000:2.0:1789428165.071531:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940190208 00000100:00100000:2.0:1789428165.071567:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789428165.071573:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940190208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428165.071617:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940190208:12345-0@lo:400:kworker.0 Request processed in 45us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428165.071623:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1789428165.072675:0:24242:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000100:00100000:1.0:1789428165.072844:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940190208:0@lo:400:kworker.0 00000020:00000080:0.0:1789428165.072870:0:24242:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1789428165.072914:0:24242:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789428165.072925:0:24242:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x84fc867ede519f32 00000100:00080000:0.0:1789428165.072932:0:24242:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789428165.072940:0:24242:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9196bc9e3000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:0.0:1789428165.072971:0:24242:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfb8c700 x1876350940190464/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789428165.073009:0:24242:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789428165.073072:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3612:1876350940190464:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789428165.073119:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789428165.073177:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428165.073182:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789428165.073185:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428165.073188:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789428165.073191:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428165.073194:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789428165.073196:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428165.073199:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789428165.073461:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940190464 00000100:00100000:1.0:1789428165.073467:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940190464 00000100:00100000:1.0:1789428165.073507:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789428165.073514:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1876350940190464:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789428165.073537:0:22718:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:1.0:1789428165.073569:0:22718:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x84fc867ede519f39 00000004:00100000:1.0:1789428165.073583:0:22718:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789428165.073611:0:22718:0:(import.c:65:import_set_state_nolock()) ffff919583042000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789428165.073664:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3612:x1876350940190464:12345-0@lo:38:llog_process_th.0 Request processed in 148us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428165.073679:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789428165.074176:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bfb8c700 x1876350940190464/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428165.074186:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789428165.074192:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1789428165.074199:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789428165.074203:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789428165.074205:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bc9e3000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789428165.074210:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3612:1876350940190464:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789428165.074372:0:24242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1789428165.074825:0:24216:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789428165.074858:0:24216:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789428165.074880:0:24216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583428400/0x84fc867ede519f08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519f0f expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428165.074891:0:24216:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583428400/0x84fc867ede519f08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519f0f expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789428165.074962:0:24216:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789428165.074964:0:24216:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789428165.074966:0:24216:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428165.074967:0:24216:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428165.074969:0:24216:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428165.074970:0:24216:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428165.074971:0:24216:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428165.074973:0:24216:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428165.074975:0:24216:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789428165.074978:0:24216:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789428165.074980:0:24216:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789428165.074982:0:24216:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789428165.074983:0:24216:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789428165.074984:0:24216:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789428165.074985:0:24216:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789428165.074986:0:24216:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789428165.074987:0:24216:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789428165.074988:0:24216:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789428165.074989:0:24216:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789428165.075009:0:24216:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789428165.075023:0:24216:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940190592:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789428165.075070:0:24216:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428165.075095:0:24216:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ad8bb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789428165.075281:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940190592 00000100:00100000:2.0:1789428165.075288:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940190592 00000100:00100000:2.0:1789428165.075324:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789428165.075333:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+21:24216:x1876350940190592:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789428165.075357:0:22710:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789428165.075371:0:22710:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789428165.081943:0:22710:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789428165.081992:0:22710:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789428165.082240:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+21:24216:x1876350940190592:12345-0@lo:253:mount.lustre.0 Request processed in 6904us (7165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428165.082252:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789428165.082343:0:24216:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:24216:1876350940190592:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789428165.082356:0:24216:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789428165.082359:0:24216:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789428165.082361:0:24216:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789428165.082362:0:24216:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789428165.082364:0:24216:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789428165.082365:0:24216:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789428165.082366:0:24216:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789428165.082367:0:24216:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789428165.082369:0:24216:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789428165.082370:0:24216:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789428165.082385:0:24216:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1789428165.083929:0:24216:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 20000000:01000000:2.0:1789428165.086182:0:22732:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789428165.086190:0:22732:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789428165.086213:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086230:0:22732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583429400/0x84fc867ede519e8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519e83 expref: 20 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086237:0:22732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583429800/0x84fc867ede519e98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519e91 expref: 20 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086244:0:22732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086285:0:22732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583429800/0x84fc867ede519e98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede519e91 expref: 20 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086299:0:22732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583429800/0x84fc867ede519e98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede519e91 expref: 20 pid: 22711 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428165.086324:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940190720:0@lo:104: 00000100:00100000:2.0:1789428165.086385:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789428165.086453:0:22732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583429400/0x84fc867ede519e8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede519e83 expref: 20 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086461:0:22732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583429400/0x84fc867ede519e8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede519e83 expref: 20 pid: 22709 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428165.086469:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940190848:0@lo:104: 00000100:00100000:2.0:1789428165.086492:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428165.086524:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff919698a01480 going to sleep for 11 seconds 00000100:00100000:2.0:1789428165.086553:0:22700:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789428165.086578:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940190720 00000100:00100000:2.0:1789428165.086584:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940190720 00000100:00100000:2.0:1789428165.086619:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940190848 00000100:00100000:2.0:1789428165.086622:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940190848 00000100:00100000:2.0:1789428165.086636:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789428165.086645:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+4:22732:x1876350940190720:12345-0@lo:104: 00010000:00010000:2.0:1789428165.086657:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519e98 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086705:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789428165.086711:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+4:22732:x1876350940190720:12345-0@lo:104: Request processed in 67us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428165.086719:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789428165.086735:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789428165.086742:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+3:22732:x1876350940190848:12345-0@lo:104: 00010000:00010000:2.0:1789428165.086757:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519e8a expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086792:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789428165.086797:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+3:22732:x1876350940190848:12345-0@lo:104: Request processed in 56us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428165.086803:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789428165.086842:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789428165.086847:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519e98 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086854:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789428165.086857:0:23475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519e98 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086865:0:23475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519e98 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789428165.086872:0:23475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519e98 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428165.086878:0:23475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789428165.086900:0:23475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519e98 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086907:0:23475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789428165.086925:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519e98 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086931:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209000/0x84fc867ede519e91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519e98 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086952:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428165.086955:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519e8a expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086961:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208400 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789428165.086964:0:23475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519e8a expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.086970:0:23475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519e8a expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789428165.086976:0:23475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519e8a expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428165.086982:0:23475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789428165.086995:0:23475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519e8a expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087001:0:23475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789428165.087016:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519e8a expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087023:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208400/0x84fc867ede519e83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519e8a expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087034:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428165.087036:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428165.087037:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428165.087042:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428165.087058:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e871a47a-d8aa-4c92-86ef-047b0047c703:3614:1876350940190976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428165.087084:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428165.087117:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940190976 00000100:00100000:2.0:1789428165.087121:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940190976 00010000:00010000:2.0:1789428165.087137:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583429800/0x84fc867ede519e98 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519e91 expref: 21 pid: 22711 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428165.087159:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789428165.087166:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+21:3614:x1876350940190976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428165.087175:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428165.087180:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583429800/0x84fc867ede519e98 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519e91 expref: 21 pid: 22711 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087190:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583429800/0x84fc867ede519e98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede519e91 expref: 21 pid: 22711 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087203:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428165.087227:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+21:3614:x1876350940190976:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428165.087233:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789428165.087260:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940191104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428165.087282:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428165.087309:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940191104 00000100:00100000:2.0:1789428165.087312:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940191104 00010000:00010000:2.0:1789428165.087324:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583429400/0x84fc867ede519e8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519e83 expref: 21 pid: 22709 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428165.087340:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789428165.087346:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+21:3615:x1876350940191104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428165.087359:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428165.087364:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583429400/0x84fc867ede519e8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519e83 expref: 21 pid: 22709 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087371:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583429400/0x84fc867ede519e8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede519e83 expref: 21 pid: 22709 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087383:0:22701:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087390:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789428165.087401:0:22701:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013470560s 00010000:00010000:2.0:1789428165.087406:0:22701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087431:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087438:0:22701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087445:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087450:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428165.087453:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087460:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087476:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087484:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428165.087524:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+21:3615:x1876350940191104:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428165.087530:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789428165.087579:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940191104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789428165.087600:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e871a47a-d8aa-4c92-86ef-047b0047c703:3614:1876350940190976:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789428165.087621:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583429800/0x84fc867ede519e98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede519e91 expref: 20 pid: 22711 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428165.087630:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940190720:0@lo:104: 00010000:00010000:2.0:1789428165.087638:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583429400/0x84fc867ede519e8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede519e83 expref: 19 pid: 22709 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428165.087645:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940190848:0@lo:104: 00010000:00010000:2.0:1789428165.087656:0:22732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087664:0:22732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087670:0:22732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428165.087676:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428a00/0x84fc867ede519f40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1789428165.088258:0:24216:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789428165.088264:0:24216:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789428165.088300:0:24216:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789428165.088338:0:24216:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789428165.089191:0:24216:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789428165.089208:0:24216:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1789428165.090262:0:24216:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789428165.090691:0:24216:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000001:00100000:2.0:1789428165.426687:0:23449:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:3.0:1789428165.489440:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:1.0:1789428165.958002:0:24295:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789428165.958394:0:24295:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789428166.064651:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789428166.576522:0:22713:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789428166.576529:0:22713:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919583218800 from 13 10000000:01000000:2.0:1789428166.576535:0:22713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789428166.576589:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428166.576602:0:22713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428166.576614:0:22713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428166.576640:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940191232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789428166.576707:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428166.576752:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff919583e21780 going to sleep for 11 seconds 00000100:00100000:0.0:1789428166.577004:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940191232 00000100:00100000:0.0:1789428166.577012:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940191232 00000100:00100000:0.0:1789428166.577069:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789428166.577079:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+19:22713:x1876350940191232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428166.577092:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428166.577105:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685208c00/0x84fc867ede519f4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519f47 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428166.577128:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685208c00/0x84fc867ede519f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519f47 expref: 20 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428166.577138:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685208c00/0x84fc867ede519f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519f47 expref: 20 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428166.577147:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208c00, rc 0) 00000100:00100000:0.0:1789428166.577190:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+20:22713:x1876350940191232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428166.577206:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789428166.577251:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940191232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428166.577265:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519f4e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428166.577273:0:22713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519f4e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428166.577321:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940191360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789428166.577350:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428166.577365:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb9d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789428166.577556:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940191360 00000100:00100000:1.0:1789428166.577561:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940191360 00000100:00100000:1.0:1789428166.577624:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789428166.577632:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+20:22713:x1876350940191360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789428166.577650:0:22709:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789428166.577667:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789428166.577670:0:22709:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1789428166.577740:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+20:22713:x1876350940191360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428166.577746:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789428166.578127:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940191360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789428166.578187:0:22713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789428166.578194:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519f4e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428166.578203:0:22713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519f4e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428166.578212:0:22713:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789428166.578215:0:22713:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196bbbf1000 from 13 10000000:01000000:0.0:1789428166.578217:0:22713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789428166.578233:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428166.578240:0:22713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428166.578258:0:22713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428166.578272:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940191488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789428166.578299:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428166.578321:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb9d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789428166.578335:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940191488 00000100:00100000:0.0:1789428166.578339:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940191488 00000100:00100000:0.0:1789428166.578359:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789428166.578365:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+20:22713:x1876350940191488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428166.578373:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428166.578381:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919685208e00/0x84fc867ede519f5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede519f55 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428166.578396:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919685208e00/0x84fc867ede519f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede519f55 expref: 21 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428166.578404:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919685208e00/0x84fc867ede519f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519f55 expref: 21 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428166.578411:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919685208e00, rc 0) 00000100:00100000:0.0:1789428166.578462:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+21:22713:x1876350940191488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428166.578467:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789428166.578508:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940191488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428166.578519:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519f5c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428166.578532:0:22713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede519f5c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428166.578570:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940191616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789428166.578596:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428166.578614:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bcb9d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789428166.578625:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940191616 00000100:00100000:0.0:1789428166.578629:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940191616 00000100:00100000:0.0:1789428166.578646:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789428166.578651:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+21:22713:x1876350940191616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789428166.578661:0:22711:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789428166.578785:0:22711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789428166.578790:0:22711:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789428166.579023:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+21:22713:x1876350940191616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 370us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428166.579030:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789428166.579262:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940191616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789428166.579305:0:22713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789428166.579312:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519f5c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428166.579319:0:22713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519f5c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.088628:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428167.155579:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428152/real 1789428152] req@ffff91958361d180 x1876350940178304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428167 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428167.155616:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91958361d180 x1876350940178304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428167 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428167.155627:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428152/real 1789428152] req@ffff91958361f100 x1876350940178432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428167 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428167.155656:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91958361f100 x1876350940178432/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428167 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789428167.155675:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9195848d7800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789428167.155697:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789428167.155701:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940178304:0@lo:8:kworker.0 00000100:00080000:1.0:1789428167.155706:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bca11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789428167.155711:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789428167.155714:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940178432:0@lo:8:kworker.0 00000100:00080000:1.0:1789428167.155790:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428167.155794:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789428167.155796:0:469:0:(import.c:65:import_set_state_nolock()) ffff9195848d7800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789428167.155800:0:469:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1789428167.155804:0:469:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789428167.155813:0:469:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9195848d7800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428167.155829:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958361d180 x1876350940191872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789428167.155840:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428167.155843:0:469:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789428167.155844:0:469:0:(import.c:65:import_set_state_nolock()) ffff9196bca11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789428167.155847:0:469:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:1.0:1789428167.155849:0:469:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789428167.155852:0:469:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9196bca11000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428167.155861:0:469:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958361ed80 x1876350940192000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789428167.155897:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428167.155901:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789428167.155904:0:469:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789428167.155907:0:469:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789428167.155950:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940192384:0@lo:400:kworker.0 00000100:00100000:1.0:1789428167.156011:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428167.156043:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789428167.156048:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940191744:0@lo:400:kworker.0 00000100:00100000:1.0:1789428167.156075:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428167.156093:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940192512:0@lo:400:kworker.0 00000100:00100000:1.0:1789428167.156115:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428167.156138:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940192128:0@lo:400:kworker.0 00000100:00100000:1.0:1789428167.156161:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428167.156176:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940192640:0@lo:400:kworker.0 00000100:00100000:1.0:1789428167.156196:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428167.156207:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789428167.156212:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940192256:0@lo:400:kworker.0 00000100:00100000:1.0:1789428167.156229:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428167.156264:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940192384 00000100:00100000:1.0:1789428167.156272:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940192384 00000100:00100000:1.0:1789428167.156306:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940192512 00000100:00100000:1.0:1789428167.156308:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940192512 00000100:00100000:1.0:1789428167.156338:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940192128 00000100:00100000:1.0:1789428167.156340:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940192128 00000100:00100000:1.0:1789428167.156360:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940192640 00000100:00100000:1.0:1789428167.156362:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940192640 00000100:00100000:1.0:1789428167.156378:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789428167.156385:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940192384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428167.156457:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940192384:12345-0@lo:400:kworker.0 Request processed in 71us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428167.156464:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789428167.156494:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428167.156500:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940192512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428167.156525:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940192512:12345-0@lo:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428167.156530:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428167.156540:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428167.156545:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940192128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428167.156574:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940192128:12345-0@lo:400:kworker.0 Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428167.156580:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428167.156591:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789428167.156597:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940192640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428167.156622:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940192640:12345-0@lo:400:kworker.0 Request processed in 25us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428167.156627:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789428167.156644:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940191744 00000100:00100000:1.0:1789428167.156647:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940191744 00000100:00100000:1.0:1789428167.156666:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940192256 00000100:00100000:1.0:1789428167.156668:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940192256 00000100:00100000:1.0:1789428167.156679:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789428167.156690:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940191744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428167.156731:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940191744:12345-0@lo:400:kworker.0 Request processed in 41us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428167.156737:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789428167.156747:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789428167.156752:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940192256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428167.156773:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940192256:12345-0@lo:400:kworker.0 Request processed in 21us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428167.156777:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789428167.156818:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940192256:0@lo:400:kworker.0 00010000:00080000:1.0:1789428167.156828:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91958361ce00 x1876350940192128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428167.156836:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940192128:0@lo:400:kworker.0 00010000:00080000:1.0:1789428167.156845:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91958361c700 x1876350940192640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428167.156852:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940192640:0@lo:400:kworker.0 00000100:00100000:1.0:1789428167.156874:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940191872:0@lo:8:kworker.0 00000100:00100000:1.0:1789428167.156899:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428167.156928:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940192000:0@lo:8:kworker.0 00000100:00100000:1.0:1789428167.156949:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428167.156981:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940191744:0@lo:400:kworker.0 00010000:00080000:1.0:1789428167.156991:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91958361ea00 x1876350940192512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428167.157010:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940192512:0@lo:400:kworker.0 00010000:00080000:1.0:1789428167.157022:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91958361e680 x1876350940192384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428167.157030:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940192384:0@lo:400:kworker.0 00000100:00100000:2.0:1789428167.157244:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940191872 00000100:00100000:2.0:1789428167.157249:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940191872 00000100:00100000:2.0:1789428167.157275:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940192000 00000100:00100000:2.0:1789428167.157278:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940192000 00000100:00100000:2.0:1789428167.157289:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428167.157294:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940191872:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789428167.157318:0:24220:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:2.0:1789428167.157348:0:24220:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede519f63 00002000:00100000:2.0:1789428167.157361:0:24220:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff919583714000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789428167.157365:0:24220:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789428167.157368:0:24220:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789428167.157596:0:24220:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789428167.157617:0:24220:0:(import.c:65:import_set_state_nolock()) ffff919583715000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428167.157665:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3612:x1876350940191872:12345-0@lo:8:kworker.0 Request processed in 370us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428167.157673:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428167.157687:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428167.157691:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940192000:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789428167.157702:0:24220:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789428167.157726:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940192000:12345-0@lo:8:kworker.0 Request processed in 34us (777us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789428167.157732:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789428167.158734:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789428167.158740:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789428167.158850:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91958361d180 x1876350940191872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789428187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428167.158860:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789428167.158868:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1789428167.158876:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789428167.158881:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1789428167.158884:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9195848d7800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789428167.158912:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789428167.158919:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940191872:0@lo:8:kworker.0 00000100:00080000:1.0:1789428167.158931:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bca11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789428167.158935:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789428167.158938:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940192000:0@lo:8:kworker.0 00000100:00100000:1.0:1789428167.159088:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940192768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789428167.159127:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789428167.159177:0:22741:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:3.0:1789428167.159196:0:22741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa80700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22741:1876350940192896:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789428167.159221:0:22741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428167.159235:0:22741:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834be6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428167.159251:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940192896 00000100:00100000:3.0:1789428167.159256:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940192896 00000100:00100000:3.0:1789428167.159292:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789428167.159299:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22741:x1876350940192896:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1789428167.159537:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789428167.159728:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940192768 00000100:00100000:2.0:1789428167.159733:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940192768 00000100:00100000:2.0:1789428167.159766:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789428167.159774:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1876350940192768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789428167.159794:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000004:00080000:0.0:1789428167.160169:0:22740:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789428167.160252:0:22740:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 511654835945ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789428167.160259:0:22740:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789428167.163866:0:22696:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789428167.164694:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1876350940192768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4916us (5561us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428167.164707:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:3.0:1789428167.165373:0:24220:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789428167.165383:0:24220:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -59 00002000:02000040:3.0:1789428167.165388:0:24220:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:65) 00010000:00080000:0.0:1789428167.176085:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bfa81500 x1876350940192768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789428183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428167.176117:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940192768:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1789428167.180366:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428167.180378:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d60ae00/0x84fc867ede519f6a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.180396:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1789428167.180401:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428167.182016:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d60ae00/0x84fc867ede519f6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.182053:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d60ae00/0x84fc867ede519f6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.182066:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d60ae00/0x84fc867ede519f6a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.182075:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d60ae00/0x84fc867ede519f6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.182262:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789428167.188853:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428167.188868:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd3fb4f/0x84fc867ede519f71 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.188885:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1789428167.188890:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428167.188897:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd3fb4f/0x84fc867ede519f71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.188911:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdd3fb4f/0x84fc867ede519f71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.188923:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd3fb4f/0x84fc867ede519f71 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.188944:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd3fb4f/0x84fc867ede519f71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.188969:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789428167.189878:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428167.189885:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b03714d/0x84fc867ede519f78 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.189897:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1789428167.189900:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428167.189904:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007b03714d/0x84fc867ede519f78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.189912:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007b03714d/0x84fc867ede519f78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.189921:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007b03714d/0x84fc867ede519f78 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.189928:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007b03714d/0x84fc867ede519f78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.189942:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789428167.189951:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789428167.189956:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d60ae00/0x84fc867ede519f6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.189969:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9e00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428167.189974:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d60ae00/0x84fc867ede519f6a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.189982:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d60ae00/0x84fc867ede519f6a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.189997:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d60ae00/0x84fc867ede519f6a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190004:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d60ae00/0x84fc867ede519f6a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190017:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789428167.190020:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdd3fb4f/0x84fc867ede519f71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190026:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e8600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428167.190029:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd3fb4f/0x84fc867ede519f71 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190036:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd3fb4f/0x84fc867ede519f71 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190045:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdd3fb4f/0x84fc867ede519f71 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190057:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdd3fb4f/0x84fc867ede519f71 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190069:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428167.190073:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007b03714d/0x84fc867ede519f78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190078:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428167.190082:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007b03714d/0x84fc867ede519f78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190089:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007b03714d/0x84fc867ede519f78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190099:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007b03714d/0x84fc867ede519f78 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.190103:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.190107:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007b03714d/0x84fc867ede519f78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190117:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.190118:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.190120:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428167.190717:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428167.190725:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187875f2/0x84fc867ede519f7f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190738:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1789428167.190742:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428167.190746:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187875f2/0x84fc867ede519f7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190755:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187875f2/0x84fc867ede519f7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190763:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187875f2/0x84fc867ede519f7f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190771:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187875f2/0x84fc867ede519f7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190785:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428167.190792:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428167.190795:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187875f2/0x84fc867ede519f7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190803:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e8800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428167.190806:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187875f2/0x84fc867ede519f7f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190813:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187875f2/0x84fc867ede519f7f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190834:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187875f2/0x84fc867ede519f7f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190841:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187875f2/0x84fc867ede519f7f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.190854:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.190855:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.190858:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428167.191390:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428167.191397:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6c4a88a/0x84fc867ede519f86 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.191406:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1789428167.191431:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428167.191437:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6c4a88a/0x84fc867ede519f86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.191447:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6c4a88a/0x84fc867ede519f86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.191456:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6c4a88a/0x84fc867ede519f86 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.191463:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6c4a88a/0x84fc867ede519f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.191494:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428167.191502:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428167.191506:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6c4a88a/0x84fc867ede519f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.191512:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196c21e9400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428167.191515:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6c4a88a/0x84fc867ede519f86 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.191522:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6c4a88a/0x84fc867ede519f86 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.191532:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6c4a88a/0x84fc867ede519f86 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.191549:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6c4a88a/0x84fc867ede519f86 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.191564:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.191566:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.191567:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428167.192471:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428167.194288:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428167.194301:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519f8d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.194321:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1789428167.194326:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428167.194332:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.194346:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.194356:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519f8d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.194365:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.194389:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428167.194459:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428167.194466:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.194474:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428167.194493:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519f8d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.194501:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519f8d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.194516:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519f8d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.194523:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040cc4f1f/0x84fc867ede519f8d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.194538:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.194540:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.194542:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428167.195015:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428167.195022:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519f94 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.195030:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1789428167.195034:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428167.195038:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519f94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.195047:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519f94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.195066:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519f94 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.195073:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519f94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.195094:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428167.195329:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428167.195335:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519f94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.195343:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428167.195346:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519f94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.195355:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519f94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.195367:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519f94 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.195381:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070c4bae6/0x84fc867ede519f94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.195396:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.195398:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.195400:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428167.195728:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428167.195735:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010fde08f/0x84fc867ede519f9b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.195742:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1789428167.195745:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428167.195749:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010fde08f/0x84fc867ede519f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.195759:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010fde08f/0x84fc867ede519f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.195766:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010fde08f/0x84fc867ede519f9b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.195773:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010fde08f/0x84fc867ede519f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.196621:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789428167.198685:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428167.198697:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000973575ee/0x84fc867ede519fa2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.198713:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1789428167.198717:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428167.198722:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000973575ee/0x84fc867ede519fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.198735:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000973575ee/0x84fc867ede519fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.198745:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000973575ee/0x84fc867ede519fa2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.198753:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000973575ee/0x84fc867ede519fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.198773:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428167.199074:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428167.199083:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010fde08f/0x84fc867ede519f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.199093:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428167.199098:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010fde08f/0x84fc867ede519f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.199119:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010fde08f/0x84fc867ede519f9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.199138:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010fde08f/0x84fc867ede519f9b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.199145:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010fde08f/0x84fc867ede519f9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.199163:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428167.199166:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000973575ee/0x84fc867ede519fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.199172:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680030600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428167.199175:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000973575ee/0x84fc867ede519fa2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.199182:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000973575ee/0x84fc867ede519fa2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.199191:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000973575ee/0x84fc867ede519fa2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.199198:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000973575ee/0x84fc867ede519fa2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.199223:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428167.199225:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428167.199227:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428167.202881:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428167.205714:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428167.205737:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb09a52c/0x84fc867ede519fa9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.205753:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1789428167.205757:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428167.205763:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb09a52c/0x84fc867ede519fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.205777:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb09a52c/0x84fc867ede519fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.205786:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb09a52c/0x84fc867ede519fa9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.205793:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb09a52c/0x84fc867ede519fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.205821:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789428167.206219:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428167.206225:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063fe139c/0x84fc867ede519fb0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206233:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1789428167.206236:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428167.206240:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063fe139c/0x84fc867ede519fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206249:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063fe139c/0x84fc867ede519fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206258:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063fe139c/0x84fc867ede519fb0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206265:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063fe139c/0x84fc867ede519fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206282:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789428167.206607:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428167.206613:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519fb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206622:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1789428167.206629:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428167.206633:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206643:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206651:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519fb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206659:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206674:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789428167.206685:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789428167.206691:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb09a52c/0x84fc867ede519fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206699:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680030000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428167.206703:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb09a52c/0x84fc867ede519fa9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206712:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb09a52c/0x84fc867ede519fa9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206729:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb09a52c/0x84fc867ede519fa9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206748:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb09a52c/0x84fc867ede519fa9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206764:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789428167.206768:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063fe139c/0x84fc867ede519fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206775:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428167.206778:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063fe139c/0x84fc867ede519fb0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206787:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063fe139c/0x84fc867ede519fb0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206797:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063fe139c/0x84fc867ede519fb0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206805:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063fe139c/0x84fc867ede519fb0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206815:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428167.206818:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206825:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428167.206833:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519fb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206841:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519fb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206852:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519fb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206860:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c7c80bcb/0x84fc867ede519fb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.206872:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.206874:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.206876:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428167.207113:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428167.207119:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519fbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207128:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1789428167.207131:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428167.207135:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207144:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207151:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519fbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207163:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207176:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428167.207183:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428167.207187:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207194:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428167.207198:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519fbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207206:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519fbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207217:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519fbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207224:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000cdbcd20/0x84fc867ede519fbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207238:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.207240:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.207241:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428167.207782:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428167.207796:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede519fc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207806:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1789428167.207809:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428167.207812:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede519fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207821:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede519fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207830:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede519fc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207837:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede519fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207852:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428167.207859:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428167.207863:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede519fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207869:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428167.207873:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede519fc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207879:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede519fc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207894:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede519fc5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207901:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021d0301b/0x84fc867ede519fc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.207914:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.207916:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.207918:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428167.208275:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428167.208281:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519fcc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208289:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1789428167.208292:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428167.208296:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208304:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208311:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519fcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208317:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208339:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428167.208345:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428167.208348:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208354:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428167.208357:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519fcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208365:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519fcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208375:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519fcc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208381:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e90fca2/0x84fc867ede519fcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208393:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.208395:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.208396:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428167.208498:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428167.208675:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428167.208681:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede519fd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208691:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1789428167.208698:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428167.208702:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede519fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208711:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede519fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208719:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede519fd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208726:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede519fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.208746:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789428167.209006:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428167.209011:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519fda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.209019:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1789428167.209022:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428167.209026:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.209035:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.209042:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519fda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.209055:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.209071:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789428167.209097:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789428167.209103:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede519fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.209120:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789428167.209123:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede519fd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.209130:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede519fd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.209143:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede519fd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.209150:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000609d77c5/0x84fc867ede519fd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.209166:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428167.209169:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.209175:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789428167.209178:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519fda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.209186:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519fda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.209196:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519fda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.209208:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c636f4f3/0x84fc867ede519fda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.209221:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428167.209223:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428167.209224:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428167.210179:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789428167.210187:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519fe1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210196:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=511s v=(0 0) 00010000:00010000:1.0:1789428167.210200:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428167.210204:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210213:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210221:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519fe1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210227:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210239:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789428167.210246:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428167.210254:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210261:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789428167.210264:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519fe1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210281:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519fe1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210293:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519fe1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210300:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede519fe1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210313:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428167.210315:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428167.210316:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.210356:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428167.210898:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789428167.210904:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede519fe8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210913:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=511s v=(0 0) 00010000:00010000:1.0:1789428167.210916:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428167.210919:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede519fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210939:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede519fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210949:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede519fe8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210956:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede519fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.210977:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428167.211015:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428167.211021:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede519fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.211028:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ea00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428167.211032:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede519fe8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.211049:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede519fe8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.211062:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede519fe8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.211070:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc593d5b/0x84fc867ede519fe8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.211084:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.211086:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.211088:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428167.211273:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789428167.211278:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f34cfd8/0x84fc867ede519fef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.211286:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=511s v=(0 0) 00010000:00010000:1.0:1789428167.211289:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428167.211293:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002f34cfd8/0x84fc867ede519fef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.211300:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002f34cfd8/0x84fc867ede519fef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.211308:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002f34cfd8/0x84fc867ede519fef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.211323:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002f34cfd8/0x84fc867ede519fef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.211341:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428167.211442:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428167.211447:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002f34cfd8/0x84fc867ede519fef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.211449:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.211455:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428167.211458:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002f34cfd8/0x84fc867ede519fef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.211465:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002f34cfd8/0x84fc867ede519fef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.211476:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002f34cfd8/0x84fc867ede519fef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.211504:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002f34cfd8/0x84fc867ede519fef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.211517:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.211519:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.211521:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428167.211679:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789428167.211684:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078e93482/0x84fc867ede519ff6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.211696:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=511s v=(0 0) 00010000:00010000:1.0:1789428167.211699:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428167.211702:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078e93482/0x84fc867ede519ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.211710:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078e93482/0x84fc867ede519ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.211717:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078e93482/0x84fc867ede519ff6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.211724:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078e93482/0x84fc867ede519ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.211739:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428167.211992:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428167.211997:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078e93482/0x84fc867ede519ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.212005:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428167.212009:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078e93482/0x84fc867ede519ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.212016:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078e93482/0x84fc867ede519ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.212026:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078e93482/0x84fc867ede519ff6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.212033:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078e93482/0x84fc867ede519ff6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.212045:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.212046:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.212048:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428167.213181:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789428167.213196:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004657e5fb/0x84fc867ede519ffd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.213208:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=511s v=(0 0) 00010000:00010000:1.0:1789428167.213213:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428167.213218:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004657e5fb/0x84fc867ede519ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.213229:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004657e5fb/0x84fc867ede519ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.213238:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004657e5fb/0x84fc867ede519ffd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.213246:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004657e5fb/0x84fc867ede519ffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.213272:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428167.213554:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428167.213560:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004657e5fb/0x84fc867ede519ffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.213568:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428167.213572:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004657e5fb/0x84fc867ede519ffd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.213580:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004657e5fb/0x84fc867ede519ffd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.213594:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004657e5fb/0x84fc867ede519ffd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.213600:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004657e5fb/0x84fc867ede519ffd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.213614:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.213617:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.213618:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428167.219893:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428167.219907:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059fbc27c/0x84fc867ede51a004 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.219935:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1789428167.219941:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428167.219947:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059fbc27c/0x84fc867ede51a004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.219961:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059fbc27c/0x84fc867ede51a004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.219971:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059fbc27c/0x84fc867ede51a004 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.219978:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059fbc27c/0x84fc867ede51a004 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.219992:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428167.221004:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428167.221013:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059fbc27c/0x84fc867ede51a004 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.221023:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428167.221027:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059fbc27c/0x84fc867ede51a004 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.221049:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059fbc27c/0x84fc867ede51a004 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.221068:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059fbc27c/0x84fc867ede51a004 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.221074:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059fbc27c/0x84fc867ede51a004 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428167.221091:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.221093:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428167.221095:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428167.222251:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789428167.222261:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede51a00b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.222274:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=511s v=(0 0) 00010000:00010000:1.0:1789428167.222278:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428167.222285:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede51a00b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.222302:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede51a00b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.222319:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede51a00b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.222328:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede51a00b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.222349:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428167.222365:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428167.222371:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede51a00b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.222387:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428167.222391:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede51a00b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.222398:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede51a00b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.222411:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede51a00b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.222434:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd478328/0x84fc867ede51a00b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.222450:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428167.222451:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428167.222453:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789428167.222734:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789428167.222742:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede51a012 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.222750:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=511s v=(0 0) 00010000:00010000:1.0:1789428167.222753:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428167.222757:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede51a012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.222768:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede51a012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.222775:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede51a012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.222782:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede51a012 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428167.222809:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428167.223005:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428167.223011:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede51a012 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.223018:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1ec00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428167.223021:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede51a012 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.223030:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede51a012 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.223048:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede51a012 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.223055:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a53cfe6/0x84fc867ede51a012 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.223068:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428167.223070:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428167.223071:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428167.225113:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428167.225122:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e35a846/0x84fc867ede51a019 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.225133:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1789428167.225136:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428167.225141:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e35a846/0x84fc867ede51a019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.225153:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e35a846/0x84fc867ede51a019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.225162:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e35a846/0x84fc867ede51a019 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.225170:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e35a846/0x84fc867ede51a019 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.225201:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428167.225221:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428167.225228:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e35a846/0x84fc867ede51a019 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.225236:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428167.225240:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e35a846/0x84fc867ede51a019 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.225248:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e35a846/0x84fc867ede51a019 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.225263:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e35a846/0x84fc867ede51a019 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.225270:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e35a846/0x84fc867ede51a019 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.225285:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.225287:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.225289:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428167.225585:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428167.225590:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede51a020 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.225596:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1789428167.225598:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428167.225601:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede51a020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.225607:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede51a020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.225611:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede51a020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.225616:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede51a020 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.225629:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428167.225650:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428167.225661:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede51a020 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.225668:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428167.225671:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede51a020 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.225679:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede51a020 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.225691:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede51a020 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.225699:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000029551ae/0x84fc867ede51a020 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.225712:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.225713:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.225715:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428167.226193:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428167.226198:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dbcdf3c/0x84fc867ede51a027 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.226204:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1789428167.226210:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428167.226213:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001dbcdf3c/0x84fc867ede51a027 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.226220:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001dbcdf3c/0x84fc867ede51a027 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.226225:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001dbcdf3c/0x84fc867ede51a027 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.226229:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001dbcdf3c/0x84fc867ede51a027 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.226243:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428167.226264:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428167.226269:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001dbcdf3c/0x84fc867ede51a027 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.226277:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428167.226280:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001dbcdf3c/0x84fc867ede51a027 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.226298:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001dbcdf3c/0x84fc867ede51a027 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.226309:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001dbcdf3c/0x84fc867ede51a027 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.226317:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001dbcdf3c/0x84fc867ede51a027 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.226331:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.226333:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.226335:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428167.226506:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428167.226511:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c899cf22/0x84fc867ede51a02e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.226518:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1789428167.226521:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428167.226525:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c899cf22/0x84fc867ede51a02e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.226534:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c899cf22/0x84fc867ede51a02e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.226542:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c899cf22/0x84fc867ede51a02e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.226556:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c899cf22/0x84fc867ede51a02e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.226575:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428167.226711:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428167.226716:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c899cf22/0x84fc867ede51a02e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.226724:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428167.226727:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c899cf22/0x84fc867ede51a02e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.226734:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c899cf22/0x84fc867ede51a02e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.226746:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c899cf22/0x84fc867ede51a02e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.226763:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c899cf22/0x84fc867ede51a02e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.226776:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.226777:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.226779:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428167.227008:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428167.227012:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000654ab2d9/0x84fc867ede51a035 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.227017:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1789428167.227019:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428167.227022:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000654ab2d9/0x84fc867ede51a035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.227028:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000654ab2d9/0x84fc867ede51a035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.227033:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000654ab2d9/0x84fc867ede51a035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.227037:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000654ab2d9/0x84fc867ede51a035 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.227049:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428167.227069:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428167.227074:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000654ab2d9/0x84fc867ede51a035 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.227081:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429c00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428167.227084:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000654ab2d9/0x84fc867ede51a035 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.227092:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000654ab2d9/0x84fc867ede51a035 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.227103:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000654ab2d9/0x84fc867ede51a035 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.227111:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000654ab2d9/0x84fc867ede51a035 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.227123:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.227125:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.227127:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428167.227605:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428167.227610:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000983e2678/0x84fc867ede51a03c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.227621:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1789428167.227623:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428167.227626:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000983e2678/0x84fc867ede51a03c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.227632:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000983e2678/0x84fc867ede51a03c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.227637:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000983e2678/0x84fc867ede51a03c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.227642:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000983e2678/0x84fc867ede51a03c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.227654:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428167.227677:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428167.227682:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000983e2678/0x84fc867ede51a03c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.227689:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375d800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428167.227692:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000983e2678/0x84fc867ede51a03c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.227700:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000983e2678/0x84fc867ede51a03c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.227711:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000983e2678/0x84fc867ede51a03c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.227718:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000983e2678/0x84fc867ede51a03c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.227731:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.227733:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.227735:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428167.228029:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428167.228035:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed610261/0x84fc867ede51a043 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.228043:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1789428167.228047:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428167.228051:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed610261/0x84fc867ede51a043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.228060:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed610261/0x84fc867ede51a043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.228078:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed610261/0x84fc867ede51a043 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.228085:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed610261/0x84fc867ede51a043 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428167.228106:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789428167.228322:0:24220:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1789428167.228444:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22741:x1876350940192896:12345-0@lo:5:osp-pre-0-0.0 Request processed in 69141us (69216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428167.228454:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789428167.228626:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428167.228633:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed610261/0x84fc867ede51a043 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.228640:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375d400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428167.228643:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed610261/0x84fc867ede51a043 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.228662:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed610261/0x84fc867ede51a043 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.228674:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed610261/0x84fc867ede51a043 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.228681:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed610261/0x84fc867ede51a043 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428167.228696:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.228697:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428167.228699:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428167.229753:0:22741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa80700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22741:1876350940192896:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789428167.229771:0:22741:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1789428167.229821:0:22741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbcad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22741:1876350940193024:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789428167.229887:0:22741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428167.230383:0:22741:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789428167.245675:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940193024 00000100:00100000:1.0:1789428167.245705:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940193024 00000100:00100000:1.0:1789428167.245794:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789428167.245805:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22741:x1876350940193024:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789428167.245852:0:24222:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:0.0:1789428167.251996:0:24217:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1789428167.252063:0:24217:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789428167.252400:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22741:x1876350940193024:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6591us (22506us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789428167.252433:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789428167.252451:0:22741:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1789428167.252462:0:22741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbcad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22741:1876350940193024:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789428167.252494:0:22741:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:0.0:1789428168.112648:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428169.015978:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940193152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789428169.016049:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428169.016100:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940193152 00000100:00100000:3.0:1789428169.016110:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940193152 00000100:00100000:3.0:1789428169.016221:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789428169.016231:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940193152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789428169.016263:0:23457:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789428169.016315:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940193152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428169.016322:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789428169.016459:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940193152:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789428169.136717:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789428169.512027:0:24585:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789428169.520581:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940193280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789428169.520646:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428169.520710:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940193280 00000100:00100000:1.0:1789428169.520717:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940193280 00000100:00100000:1.0:1789428169.520753:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789428169.520761:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940193280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789428169.520804:0:22721:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789428169.520845:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940193280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428169.520852:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789428169.520892:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940193280:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1789428170.101691:0:24637:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789428170.101906:0:24637:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789428170.160701:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789428170.696908:0:24687:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789428170.697123:0:24687:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789428171.184834:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428172.209566:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789428172.594458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428172.594468:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789428172.594473:0:8:0:(import.c:65:import_set_state_nolock()) ffff9196bca11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428172.594483:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 511 00000100:00080000:2.0:1789428172.594491:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789428172.594505:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9196bca11000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:1.0:1789428172.594521:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e871a47a-d8aa-4c92-86ef-047b0047c703:3613:1876350940193408:0@lo:400:kworker.0 00000100:00100000:2.0:1789428172.594535:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91958444f800 x1876350940193792/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789428172.594567:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428172.594571:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789428172.594574:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428172.594596:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789428172.594638:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940193664:0@lo:400:kworker.0 00000100:00100000:2.0:1789428172.594707:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428172.594767:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940194304:0@lo:400:kworker.0 00000100:00100000:1.0:1789428172.594767:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428172.594798:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428172.594808:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940194048:0@lo:400:kworker.0 00000100:00100000:2.0:1789428172.594819:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789428172.594824:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940193920:0@lo:400:kworker.0 00000100:00100000:1.0:1789428172.594834:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428172.594841:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428172.594850:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789428172.594854:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940194432:0@lo:400:kworker.0 00000100:00100000:1.0:1789428172.594855:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940193536:0@lo:400:kworker.0 00000100:00100000:1.0:1789428172.594875:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428172.594879:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428172.594889:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940194176:0@lo:400:kworker.0 00000100:00100000:2.0:1789428172.594908:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940193792:0@lo:8:kworker.0 00000100:00100000:1.0:1789428172.594909:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428172.594934:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428172.594954:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940193408 00000100:00100000:2.0:1789428172.594960:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940193664 00000100:00100000:2.0:1789428172.594963:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940193664 00000100:00100000:1.0:1789428172.594963:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940193408 00000100:00100000:2.0:1789428172.595010:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940193792 00000100:00100000:2.0:1789428172.595013:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940193792 00000100:00100000:1.0:1789428172.595014:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789428172.595024:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789428172.595025:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+21:3613:x1876350940193408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428172.595030:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940193664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428172.595072:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940193664:12345-0@lo:400:kworker.0 Request processed in 42us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428172.595080:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789428172.595084:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+21:3613:x1876350940193408:12345-0@lo:400:kworker.0 Request processed in 49us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428172.595090:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789428172.595095:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789428172.595100:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940193792:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789428172.595122:0:24220:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789428172.595122:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940194304 00000100:00100000:1.0:1789428172.595125:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940194304 00000100:00100000:1.0:1789428172.595145:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940193920 00000100:00100000:1.0:1789428172.595155:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940193920 00000100:00100000:1.0:1789428172.595172:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940194432 00000100:00100000:1.0:1789428172.595174:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940194432 00000100:00100000:1.0:1789428172.595187:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940194176 00000100:00100000:1.0:1789428172.595189:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940194176 00000100:00100000:1.0:1789428172.595202:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789428172.595208:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940194304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428172.595480:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940194048 00000100:00100000:3.0:1789428172.595485:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940194048 00000100:00100000:3.0:1789428172.595522:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940193536 00000100:00100000:3.0:1789428172.595525:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940193536 00000100:00100000:3.0:1789428172.595537:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789428172.595544:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940194048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428172.600784:0:22716:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789428172.600811:0:22716:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789428172.600860:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789428172.600884:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940193536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428172.601000:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940193536:12345-0@lo:400:kworker.0 Request processed in 128us (6124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428172.601009:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789428172.601049:0:22718:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789428172.601061:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789428172.602335:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940193920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428172.607802:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940194048:12345-0@lo:400:kworker.0 Request processed in 12245us (12954us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428172.607823:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789428172.607955:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789428172.607975:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940194560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789428172.608037:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428172.608095:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940194560 00000100:00100000:3.0:1789428172.608105:0:24225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940194560 00000100:00100000:3.0:1789428172.608157:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789428172.608167:0:24225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940194560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789428172.608202:0:24225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789428172.608249:0:24225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940194560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428172.608255:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789428172.608302:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940194560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789428172.609573:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940193920:12345-0@lo:400:kworker.0 Request processed in 8497us (14723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428172.609596:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789428172.609640:0:22718:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789428172.609654:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789428172.609665:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940194432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428172.609730:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940194432:12345-0@lo:400:kworker.0 Request processed in 70us (14849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428172.609735:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789428172.609745:0:22718:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789428172.609750:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789428172.609763:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940194176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428172.609794:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940194176:12345-0@lo:400:kworker.0 Request processed in 32us (14884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428172.609799:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789428172.609956:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940193536:0@lo:400:kworker.0 00010000:00080000:1.0:1789428172.609973:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91958444ce00 x1876350940194176/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428172.609984:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940194176:0@lo:400:kworker.0 00000100:00100000:1.0:1789428172.609997:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940194048:0@lo:400:kworker.0 00000100:00100000:1.0:1789428172.610008:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e871a47a-d8aa-4c92-86ef-047b0047c703:3613:1876350940193408:0@lo:400:kworker.0 00000100:00100000:1.0:1789428172.610092:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940194304:12345-0@lo:400:kworker.0 Request processed in 14882us (15290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428172.610100:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789428172.615862:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789428172.615876:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789428172.615881:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789428172.619762:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91958444d500 x1876350940193920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428172.619787:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940193920:0@lo:400:kworker.0 00010000:00080000:3.0:1789428172.619802:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91958444e680 x1876350940194432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428172.619825:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940194432:0@lo:400:kworker.0 00000100:00100000:3.0:1789428172.619841:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940193664:0@lo:400:kworker.0 00010000:00080000:3.0:1789428172.619853:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91958444c700 x1876350940194304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428172.619861:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940194304:0@lo:400:kworker.0 00000100:00100000:2.0:1789428172.620161:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940193792:12345-0@lo:8:kworker.0 Request processed in 25056us (25222us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789428172.620179:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789428172.620301:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bca11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789428172.620308:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789428172.620312:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940193792:0@lo:8:kworker.0 00010000:00010000:0.0:1789428173.232670:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428174.132596:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789428174.132620:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940194688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789428174.132699:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428174.132799:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940194688 00000100:00100000:0.0:1789428174.132808:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940194688 00000100:00100000:0.0:1789428174.132868:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789428174.132878:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940194688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789428174.132913:0:22721:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789428174.132981:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940194688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428174.133105:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789428174.133153:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940194688:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789428174.265009:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428174.646825:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789428174.648309:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940194816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789428174.648390:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428174.648810:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940194816 00000100:00100000:3.0:1789428174.648819:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940194816 00000100:00100000:3.0:1789428174.648875:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789428174.648884:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940194816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789428174.648928:0:22722:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789428174.648996:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940194816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428174.649004:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789428174.649028:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940194816:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789428175.282201:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789428175.284571:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789428175.731862:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789428176.314593:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789428176.441528:0:25034:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789428176.441532:0:25034:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789428176.441534:0:25034:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789428176.441692:0:25034:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff919583717800 00000020:01000004:0.0:1789428176.441708:0:25034:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789428176.441723:0:25034:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789428176.441736:0:25034:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9196bf988000) 00000020:00000080:0.0:1789428176.441753:0:25034:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789428176.514994:0:25034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789428176.523225:0:25034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789428176.523771:0:25034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789428176.524023:0:25034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789428176.525185:0:25034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789428176.525708:0:25034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789428176.526265:0:25034:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1789428176.537230:0:25034:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789428176.537808:0:25034:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789428176.537823:0:25034:0:(osd_handler.c:8926:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789428176.537843:0:25034:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x84fc867ede51a051 00000020:01000004:2.0:1789428176.537853:0:25034:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789428176.537875:0:25034:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.124@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789428176.537889:0:25034:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.124@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789428176.537896:0:25034:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789428176.537927:0:25034:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789428176.537931:0:25034:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.124@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789428176.564259:0:25034:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.124@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789428176.564309:0:25034:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.124@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789428176.564317:0:25034:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789428176.564319:0:25034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789428176.564320:0:25034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789428176.564321:0:25034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789428176.564322:0:25034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789428176.564324:0:25034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789428176.564325:0:25034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789428176.564326:0:25034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789428176.564328:0:25034:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789428176.564332:0:25034:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789428176.564334:0:25034:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789428176.564335:0:25034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789428176.564336:0:25034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789428176.564337:0:25034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789428176.564338:0:25034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789428176.564339:0:25034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789428176.564340:0:25034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789428176.564341:0:25034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789428176.564342:0:25034:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789428176.564376:0:25034:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789428176.564407:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940194944:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789428176.564602:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428176.564725:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789428176.568640:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940194944 00000100:00100000:3.0:1789428176.568676:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940194944 00000100:00100000:3.0:1789428176.568752:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789428176.568763:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+21:25034:x1876350940194944:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789428176.568800:0:22710:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789428176.568803:0:22710:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1789428176.568807:0:22710:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789428176.569363:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+21:25034:x1876350940194944:12345-0@lo:253:mount.lustre.0 Request processed in 600us (4759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428176.569371:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789428176.569632:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940194944:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789428176.569645:0:25034:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789428176.569648:0:25034:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789428176.569649:0:25034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789428176.569650:0:25034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789428176.569651:0:25034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789428176.569653:0:25034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789428176.569654:0:25034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789428176.569655:0:25034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789428176.569657:0:25034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789428176.569658:0:25034:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789428176.569681:0:25034:0:(tgt_mount.c:101:server_register_mount()) register mount ffff919583717800 from lustre-OST0001 10000000:01000000:1.0:1789428176.569711:0:25034:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789428176.569714:0:25034:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789428176.569733:0:25034:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff919688450000 local copy 00010000:00010000:1.0:1789428176.569745:0:25034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519c92 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428176.569859:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789428176.569909:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428176.569946:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789428176.570046:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940195072 00000100:00100000:0.0:1789428176.570053:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940195072 00000100:00100000:0.0:1789428176.570098:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789428176.570107:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+21:25034:x1876350940195072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428176.570177:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+21:25034:x1876350940195072:12345-0@lo:501:mount.lustre.0 Request processed in 71us (267us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789428176.570184:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789428176.570251:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195072:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789428176.570264:0:25034:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.124@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789428176.570282:0:25034:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.124@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789428176.570289:0:25034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519c92 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428176.570298:0:25034:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919685209a00/0x84fc867ede519c8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede519c92 expref: -99 pid: 22695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428176.570330:0:25034:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff919583717800 10000000:01000000:2.0:1789428176.570334:0:25034:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789428176.570340:0:25034:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789428176.570342:0:25034:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789428176.570347:0:25034:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789428176.570356:0:25034:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789428176.570377:0:25034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375ce00/0x84fc867ede51a058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428176.570385:0:25034:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff91958375ce00/0x84fc867ede51a058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428176.570407:0:25034:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff91958375ce00/0x84fc867ede51a058 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428176.570446:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789428176.570483:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428176.570505:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c1993000 going to sleep for 11 seconds 00000100:00100000:3.0:1789428176.570691:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940195200 00000100:00100000:3.0:1789428176.570696:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940195200 00000100:00100000:3.0:1789428176.570724:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789428176.570731:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+21:25034:x1876350940195200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789428176.570739:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428176.570751:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919680031e00/0x84fc867ede51a05f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51a058 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.570773:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919680031e00/0x84fc867ede51a05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51a058 expref: 22 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.570783:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919680031e00/0x84fc867ede51a05f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51a058 expref: 22 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.570792:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919680031e00, rc 0) 00000100:00100000:3.0:1789428176.570833:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+22:25034:x1876350940195200:12345-0@lo:101:mount.lustre.0 Request processed in 103us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428176.570839:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789428176.575871:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428176.575913:0:25034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff91958375ce00/0x84fc867ede51a058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a05f expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428176.575928:0:25034:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff91958375ce00/0x84fc867ede51a058 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51a05f expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789428176.578027:0:25034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:2.0:1789428176.579170:0:25034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789428176.581992:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1789428176.582062:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1789428176.582099:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1789428176.582116:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1789428176.582129:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1789428176.582142:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1789428176.582175:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1789428176.582190:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1789428176.582203:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:3.0:1789428176.582227:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:3.0:1789428176.582232:0:25034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:3.0:1789428176.582343:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428176.582450:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.582492:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789428176.583029:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940195328 00000100:00100000:0.0:1789428176.583038:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940195328 00000100:00100000:0.0:1789428176.583097:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789428176.583108:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+22:25034:x1876350940195328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428176.583264:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+22:25034:x1876350940195328:12345-0@lo:501:mount.lustre.0 Request processed in 157us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428176.583273:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789428176.583310:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195328:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428176.583347:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428176.583405:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.583511:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789428176.597435:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940195456 00000100:00100000:2.0:1789428176.597452:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940195456 00000100:00100000:0.0:1789428176.599334:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789428176.599349:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+22:25034:x1876350940195456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789428176.601927:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+22:25034:x1876350940195456:12345-0@lo:503:mount.lustre.0 Request processed in 2570us (18523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428176.601942:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789428176.602187:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195456:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789428176.602647:0:25034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789428176.602730:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195584:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428176.602789:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.602829:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789428176.602993:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940195584 00000100:00100000:1.0:1789428176.603001:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940195584 00000100:00100000:1.0:1789428176.603043:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789428176.603053:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+22:25034:x1876350940195584:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428176.606021:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+22:25034:x1876350940195584:12345-0@lo:502:mount.lustre.0 Request processed in 2960us (3222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428176.606036:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789428176.606126:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195584:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428176.606409:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1789428176.606486:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1789428176.606504:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1789428176.606516:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1789428176.606528:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1789428176.612518:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1789428176.612586:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1789428176.612602:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1789428176.612618:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1789428176.612672:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428176.612766:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.612821:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789428176.613458:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940195712 00000100:00100000:0.0:1789428176.613468:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940195712 00000100:00100000:0.0:1789428176.613532:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789428176.613542:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+22:25034:x1876350940195712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789428176.613689:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+22:25034:x1876350940195712:12345-0@lo:502:mount.lustre.0 Request processed in 147us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428176.613697:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789428176.614379:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428176.614508:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1789428176.614520:0:25034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1789428176.616257:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789428176.616268:0:25038:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789428176.616276:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428176.616278:0:25038:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789428176.616285:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789428176.616300:0:25038:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9196bf98cd40) 00000020:00000080:0.0:1789428176.616328:0:25038:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789428176.616335:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789428176.616464:0:25038:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919583717800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789428176.616475:0:25038:0:(osd_handler.c:8926:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789428176.616482:0:25038:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x84fc867ede51a06d 00010000:00010000:0.0:1789428176.623995:0:25038:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1789428176.625943:0:25038:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1789428176.628259:0:25038:0:(osd_handler.c:5582:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1789428176.665978:0:25038:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789428176.665992:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428176.665999:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428176.666001:0:25038:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789428176.666004:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789428176.666008:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428176.666010:0:25038:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789428176.666013:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789428176.666015:0:25038:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789428176.666018:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428176.666020:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428176.666021:0:25038:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789428176.666023:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789428176.666025:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428176.666027:0:25038:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789428176.666029:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789428176.666066:0:25038:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789428176.666069:0:25038:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789428176.666070:0:25038:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789428176.666074:0:25038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1789428176.666456:0:25034:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789428176.666500:0:25034:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789428176.666519:0:25034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375ce00/0x84fc867ede51a058 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a05f expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.666533:0:25034:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff91958375ce00/0x84fc867ede51a058 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a05f expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789428176.666542:0:25034:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919583717800 from 1 10000000:01000000:3.0:1789428176.666545:0:25034:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789428176.666586:0:25034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.666595:0:25034:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.666606:0:25034:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428176.666636:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195840:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789428176.666715:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.666753:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428176.670224:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940195840 00000100:00100000:1.0:1789428176.670239:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940195840 00000100:00100000:1.0:1789428176.670340:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789428176.670351:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+22:25034:x1876350940195840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789428176.670371:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428176.670391:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1f000/0x84fc867ede51a07b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51a074 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428176.670448:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1f000/0x84fc867ede51a07b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51a074 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428176.670461:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1f000/0x84fc867ede51a07b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51a074 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428176.670471:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f000, rc 0) 00000100:00100000:1.0:1789428176.670559:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+23:25034:x1876350940195840:12345-0@lo:101:mount.lustre.0 Request processed in 209us (3843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428176.670567:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789428176.670599:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428176.670627:0:25034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a07b expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428176.670639:0:25034:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51a07b expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789428176.675783:0:25034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1789428176.676094:0:25034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789428176.676290:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789428176.676317:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789428176.676335:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789428176.676361:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789428176.676378:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789428176.676403:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789428176.676443:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789428176.676466:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1789428176.676474:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1789428176.676481:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1789428176.676500:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1789428176.676511:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1789428176.676514:0:25034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1789428176.676571:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195968:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428176.676623:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428176.676655:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b7082780 going to sleep for 11 seconds 00000100:00100000:2.0:1789428176.676820:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940195968 00000100:00100000:2.0:1789428176.676828:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940195968 00000100:00100000:0.0:1789428176.677048:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789428176.677062:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+23:25034:x1876350940195968:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428176.677206:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+23:25034:x1876350940195968:12345-0@lo:501:mount.lustre.0 Request processed in 147us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428176.677213:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789428176.679311:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940195968:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789428176.679382:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196096:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789428176.679493:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.679532:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968863fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789428176.679860:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940196096 00000100:00100000:1.0:1789428176.679868:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940196096 00000100:00100000:1.0:1789428176.680132:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789428176.680142:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+23:25034:x1876350940196096:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789428176.680261:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+23:25034:x1876350940196096:12345-0@lo:503:mount.lustre.0 Request processed in 120us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428176.680269:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789428176.680732:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196096:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789428176.681267:0:25034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789428176.681345:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196224:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428176.681408:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428176.681495:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940196224 00000100:00100000:0.0:1789428176.681504:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940196224 00000100:00100000:0.0:1789428176.681545:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789428176.681553:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+23:25034:x1876350940196224:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428176.681577:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbc28000 going to sleep for 11 seconds 00000100:00100000:0.0:1789428176.681731:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+23:25034:x1876350940196224:12345-0@lo:502:mount.lustre.0 Request processed in 178us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428176.681781:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196224:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789428176.681961:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789428176.682707:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1789428176.682735:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1789428176.682751:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1789428176.682764:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1789428176.683012:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1789428176.683030:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1789428176.683043:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1789428176.683057:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1789428176.683069:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1789428176.683103:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1789428176.683134:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789428176.683188:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.683222:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbc28000 going to sleep for 11 seconds 00000100:00100000:1.0:1789428176.683372:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940196352 00000100:00100000:1.0:1789428176.683379:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940196352 00000100:00100000:0.0:1789428176.683971:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789428176.684085:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789428176.684096:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+23:25034:x1876350940196352:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789428176.684218:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+23:25034:x1876350940196352:12345-0@lo:502:mount.lustre.0 Request processed in 124us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428176.684225:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789428176.684581:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196352:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789428176.684652:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1789428176.684676:0:25034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789428176.686805:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428176.686817:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428176.686819:0:25042:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789428176.686825:0:25042:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919583717800 00000020:00000080:0.0:1789428176.686838:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428176.686844:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428176.686846:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428176.686847:0:25042:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789428176.686848:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428176.686850:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428176.686850:0:25042:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789428176.686852:0:25042:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff919583717800 00000020:00000080:0.0:1789428176.686853:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428176.686901:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428176.686905:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428176.686906:0:25042:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789428176.686908:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428176.686910:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428176.686911:0:25042:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789428176.686914:0:25042:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919583717800 00000020:00000080:0.0:1789428176.686916:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428176.686934:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428176.686937:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428176.686939:0:25042:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789428176.686942:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789428176.686944:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428176.686946:0:25042:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789428176.686951:0:25042:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff919583717800 00000020:00000080:0.0:1789428176.686952:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789428176.686967:0:25042:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789428176.686969:0:25042:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789428176.686970:0:25042:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789428176.686972:0:25042:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1789428176.687201:0:25034:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789428176.687231:0:25034:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789428176.687252:0:25034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a07b expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428176.687265:0:25034:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a07b expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428176.687311:0:25034:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789428176.687314:0:25034:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff919583717800 10000000:01000000:2.0:1789428176.687317:0:25034:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff919583717800 10000000:01000000:2.0:1789428176.687321:0:25034:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789428176.687325:0:25034:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff919583717800 from 1 10000000:01000000:2.0:1789428176.687328:0:25034:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789428176.687363:0:25034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375d200/0x84fc867ede51a082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428176.687371:0:25034:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff91958375d200/0x84fc867ede51a082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428176.687382:0:25034:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff91958375d200/0x84fc867ede51a082 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428176.687438:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196480:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789428176.687521:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428176.687559:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940196480 00000100:00100000:2.0:1789428176.687565:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c1993600 going to sleep for 11 seconds 00000100:00100000:0.0:1789428176.687566:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940196480 00000100:00100000:0.0:1789428176.687641:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789428176.687650:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+23:25034:x1876350940196480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789428176.687667:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428176.687679:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699965000/0x84fc867ede51a089 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51a082 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.687697:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699965000/0x84fc867ede51a089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51a082 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.687705:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699965000/0x84fc867ede51a089 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51a082 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.687711:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965000, rc 0) 00000100:00100000:0.0:1789428176.687745:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+24:25034:x1876350940196480:12345-0@lo:101:mount.lustre.0 Request processed in 97us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428176.687750:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789428176.687802:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196480:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789428176.687813:0:25034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff91958375d200/0x84fc867ede51a082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a089 expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428176.687819:0:25034:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff91958375d200/0x84fc867ede51a082 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51a089 expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789428176.688964:0:25034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1789428176.690144:0:25034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789428176.691518:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1789428176.691560:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1789428176.691582:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1789428176.691602:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1789428176.691624:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1789428176.691659:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1789428176.691680:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1789428176.691698:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1789428176.691717:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1789428176.691736:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1789428176.691755:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1789428176.691773:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1789428176.691789:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1789428176.691807:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1789428176.691825:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1789428176.691844:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1789428176.691864:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1789428176.691884:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1789428176.691902:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1789428176.691921:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1789428176.691950:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1789428176.691985:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1789428176.692007:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1789428176.692026:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1789428176.692044:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1789428176.692064:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1789428176.692092:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1789428176.692114:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1789428176.692135:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1789428176.692155:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1789428176.692174:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1789428176.692193:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1789428176.692213:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1789428176.692233:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1789428176.692253:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1789428176.692273:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1789428176.692294:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1789428176.692328:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1789428176.692349:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1789428176.692368:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1789428176.692388:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1789428176.692441:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1789428176.692466:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1789428176.692485:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1789428176.692503:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1789428176.692519:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1789428176.692538:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1789428176.692555:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1789428176.692718:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1789428176.692748:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1789428176.692774:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1789428176.692780:0:25034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1789428176.692892:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428176.692970:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428176.693013:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c1993540 going to sleep for 11 seconds 00000100:00100000:0.0:1789428176.693480:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940196608 00000100:00100000:0.0:1789428176.693501:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940196608 00000100:00100000:0.0:1789428176.693555:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789428176.693565:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+24:25034:x1876350940196608:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789428176.693695:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+24:25034:x1876350940196608:12345-0@lo:501:mount.lustre.0 Request processed in 132us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428176.693702:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789428176.695182:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789428176.695235:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789428176.695353:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428176.695406:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c1993540 going to sleep for 11 seconds 00000100:00100000:1.0:1789428176.698199:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940196736 00000100:00100000:1.0:1789428176.698216:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940196736 00000100:00100000:1.0:1789428176.698280:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789428176.698291:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+24:25034:x1876350940196736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789428176.698492:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+24:25034:x1876350940196736:12345-0@lo:503:mount.lustre.0 Request processed in 203us (3138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428176.698499:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789428176.699479:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789428176.703846:0:25034:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789428176.703968:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428176.704044:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428176.704086:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c1993600 going to sleep for 11 seconds 00000100:00100000:2.0:1789428176.704118:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940196864 00000100:00100000:2.0:1789428176.704124:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940196864 00000100:00100000:2.0:1789428176.704165:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789428176.704173:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+24:25034:x1876350940196864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428176.704283:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+24:25034:x1876350940196864:12345-0@lo:502:mount.lustre.0 Request processed in 109us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428176.704291:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789428176.704346:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789428176.704562:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789428176.704586:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1789428176.704599:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1789428176.704610:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1789428176.704621:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1789428176.704633:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1789428176.704654:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1789428176.704665:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1789428176.704676:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789428176.704687:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1789428176.704699:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1789428176.704710:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1789428176.704720:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1789428176.704731:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1789428176.704742:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1789428176.704766:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1789428176.704778:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1789428176.704790:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1789428176.704802:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1789428176.704815:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1789428176.704827:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1789428176.704840:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1789428176.704851:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1789428176.704864:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1789428176.704876:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1789428176.704888:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1789428176.704903:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1789428176.704916:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1789428176.704929:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1789428176.704940:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1789428176.704951:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1789428176.704975:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1789428176.704990:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1789428176.705003:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1789428176.705012:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1789428176.705024:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1789428176.705035:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1789428176.705047:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1789428176.705059:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1789428176.705081:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1789428176.705094:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1789428176.705106:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1789428176.705117:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1789428176.705128:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1789428176.705140:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1789428176.705151:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1789428176.705163:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1789428176.705188:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1789428176.705227:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428176.705269:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428176.705308:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c1993600 going to sleep for 11 seconds 00000100:00100000:2.0:1789428176.706053:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940196992 00000100:00100000:2.0:1789428176.706063:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940196992 00000100:00100000:2.0:1789428176.706101:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789428176.706110:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+24:25034:x1876350940196992:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428176.706230:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+24:25034:x1876350940196992:12345-0@lo:502:mount.lustre.0 Request processed in 120us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428176.706238:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789428176.706295:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940196992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789428176.706491:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1789428176.706517:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1789428176.706541:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940197120:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428176.706576:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428176.706599:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196c1993600 going to sleep for 11 seconds 00000100:00100000:2.0:1789428176.706615:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940197120 00000100:00100000:2.0:1789428176.706619:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940197120 00000100:00100000:2.0:1789428176.706641:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789428176.706654:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+24:25034:x1876350940197120:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789428176.706722:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+24:25034:x1876350940197120:12345-0@lo:502:mount.lustre.0 Request processed in 68us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428176.706727:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789428176.706766:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940197120:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789428176.706799:0:25034:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1789428176.706807:0:25034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789428176.710587:0:25046:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789428176.710603:0:25046:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9196888a8000) 00000020:00000080:2.0:1789428176.710627:0:25046:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789428176.710704:0:25046:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919583717800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789428176.710708:0:25046:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919583717800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789428176.710711:0:25046:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919583717800 3 00010000:00080000:2.0:1789428176.710759:0:25046:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9195827bb800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.124@tcp at head 00010000:00010000:2.0:1789428176.712364:0:25046:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789428176.717671:0:25046:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789428176.717723:0:25046:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789428176.717738:0:25046:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x84fc867ede51a097 00000100:00080000:2.0:1789428176.717749:0:25046:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789428176.717761:0:25046:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9195827bb800 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428176.717797:0:25046:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bca28a80 x1876350940197248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789428176.717819:0:25046:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789428176.718483:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940197248:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789428176.718554:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428176.718618:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940197248 00000100:00100000:1.0:1789428176.718626:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940197248 00000100:00100000:1.0:1789428176.718662:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789428176.718670:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3612:x1876350940197248:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789428176.718694:0:22718:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:1.0:1789428176.718729:0:22718:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x84fc867ede51a09e 00000004:00100000:1.0:1789428176.718743:0:22718:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789428176.718775:0:22718:0:(import.c:65:import_set_state_nolock()) ffff9196b8957000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789428176.718825:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3612:x1876350940197248:12345-0@lo:38:llog_process_th.0 Request processed in 154us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428176.718842:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789428176.718886:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bca28a80 x1876350940197248/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428176.718896:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789428176.718904:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1789428176.718911:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789428176.718916:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789428176.718918:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9195827bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789428176.718924:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3612:1876350940197248:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789428176.719360:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428176.719365:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789428176.719367:0:8:0:(import.c:65:import_set_state_nolock()) ffff9196bca11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789428176.719373:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 517 00000100:00080000:3.0:1789428176.719377:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789428176.719386:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9196bca11000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428176.719430:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfaabb80 x1876350940197632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789428176.719462:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428176.719466:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789428176.719469:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428176.719472:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789428176.719505:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940197888:0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.719545:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.719571:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789428176.719577:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940197376:0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.719597:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.719613:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940198016:0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.719631:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.719653:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940197504:0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.719678:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.719696:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940198144:0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.719715:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.719729:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789428176.719742:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940197760:0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.719763:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.719778:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940198272:0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.719795:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.719825:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940197888 00000100:00100000:3.0:1789428176.719831:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940197888 00000100:00100000:3.0:1789428176.719860:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940197376 00000100:00100000:3.0:1789428176.719864:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940197376 00000100:00100000:3.0:1789428176.719879:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789428176.719886:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940197888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.719930:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940197888:12345-0@lo:400:kworker.0 Request processed in 44us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428176.719937:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789428176.719951:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789428176.719957:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940197376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.719983:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940197376:12345-0@lo:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428176.719989:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789428176.720008:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940198016 00000100:00100000:3.0:1789428176.720012:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940198016 00000100:00100000:3.0:1789428176.720028:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940198144 00000100:00100000:3.0:1789428176.720031:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940198144 00000100:00100000:3.0:1789428176.720051:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940197760 00000100:00100000:3.0:1789428176.720054:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940197760 00000100:00100000:3.0:1789428176.720067:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940198272 00000100:00100000:3.0:1789428176.720069:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940198272 00000100:00100000:3.0:1789428176.720084:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789428176.720089:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940198016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.720129:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940198016:12345-0@lo:400:kworker.0 Request processed in 40us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428176.720135:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789428176.720148:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789428176.720153:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940198144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.720182:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940198144:12345-0@lo:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428176.720188:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789428176.720198:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789428176.720204:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940197760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.720227:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940197760:12345-0@lo:400:kworker.0 Request processed in 24us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428176.720233:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789428176.720242:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789428176.720247:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940198272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.720270:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1876350940198272:12345-0@lo:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428176.720275:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789428176.720292:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940197504 00000100:00100000:3.0:1789428176.720296:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940197504 00000100:00100000:3.0:1789428176.720323:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789428176.720329:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940197504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.720356:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940197504:12345-0@lo:400:kworker.0 Request processed in 28us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428176.720362:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789428176.720411:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940197376:0@lo:400:kworker.0 00010000:00080000:3.0:1789428176.720445:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bfaaaa00 x1876350940198016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428176.720455:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940198016:0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.720465:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940197888:0@lo:400:kworker.0 00000100:00080000:3.0:1789428176.720490:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789428176.720495:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789428176.720497:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789428176.720510:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bfaa8e00 x1876350940197760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428176.720518:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940197760:0@lo:400:kworker.0 00010000:00080000:3.0:1789428176.720528:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bfaa8700 x1876350940198272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428176.720536:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3613:1876350940198272:0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.720546:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940197504:0@lo:400:kworker.0 00010000:00080000:3.0:1789428176.720555:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bfaa8380 x1876350940198144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428176.720563:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940198144:0@lo:400:kworker.0 00000100:00100000:3.0:1789428176.720721:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940197632:0@lo:8:kworker.0 00000100:00100000:3.0:1789428176.720756:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.720787:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940197632 00000100:00100000:3.0:1789428176.720792:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940197632 00000100:00100000:3.0:1789428176.720811:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789428176.720822:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940197632:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789428176.720867:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3612:x1876350940197632:12345-0@lo:8:kworker.0 Request processed in 44us (110us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789428176.720872:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789428176.720894:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789428176.720900:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bca11000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789428176.720903:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789428176.720906:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940197632:0@lo:8:kworker.0 00000020:01000004:3.0:1789428176.721186:0:25046:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789428176.721199:0:25046:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9196bcb419c0) 00000020:00000080:3.0:1789428176.721219:0:25046:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1789428176.721312:0:25046:0:(tgt_mount.c:153:server_get_mount()) get mount ffff919583717800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789428176.721317:0:25046:0:(tgt_mount.c:187:server_put_mount()) put mount ffff919583717800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789428176.721319:0:25046:0:(obd_mount.c:710:lustre_put_lsi()) put ffff919583717800 3 00010000:00080000:3.0:1789428176.721347:0:25046:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9196bfad5000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.124@tcp at head 00010000:00010000:3.0:1789428176.722984:0:25046:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1789428176.723164:0:25046:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1789428176.723205:0:25046:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789428176.723217:0:25046:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x84fc867ede51a0ac 00000100:00080000:3.0:1789428176.723226:0:25046:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789428176.723236:0:25046:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9196bfad5000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:3.0:1789428176.723272:0:25046:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bfaabb80 x1876350940198400/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789428176.723314:0:25046:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789428176.723350:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428176.723354:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789428176.723358:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789428176.723367:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789428176.723451:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3612:1876350940198400:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789428176.723511:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.723535:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940198400 00000100:00100000:3.0:1789428176.723542:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940198400 00000100:00100000:3.0:1789428176.723569:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789428176.723576:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3612:x1876350940198400:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789428176.723599:0:22716:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 521 last 0 00000020:00000080:3.0:1789428176.723626:0:22716:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x84fc867ede51a0b3 00000004:00100000:3.0:1789428176.723640:0:22716:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789428176.723666:0:22716:0:(import.c:65:import_set_state_nolock()) ffff9196a0533000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428176.723725:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3612:x1876350940198400:12345-0@lo:38:llog_process_th.0 Request processed in 147us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428176.723732:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789428176.724135:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9196bfaabb80 x1876350940198400/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789428186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428176.724153:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789428176.724161:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1789428176.724169:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789428176.724173:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789428176.724175:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bfad5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789428176.724181:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3612:1876350940198400:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1789428176.727988:0:25046:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1789428176.728119:0:25034:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789428176.728152:0:25034:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789428176.728174:0:25034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff91958375d200/0x84fc867ede51a082 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a089 expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428176.728186:0:25034:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff91958375d200/0x84fc867ede51a082 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a089 expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789428176.728234:0:25034:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789428176.728237:0:25034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789428176.728238:0:25034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789428176.728240:0:25034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789428176.728241:0:25034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789428176.728242:0:25034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789428176.728244:0:25034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789428176.728245:0:25034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789428176.728247:0:25034:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789428176.728250:0:25034:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789428176.728253:0:25034:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789428176.728254:0:25034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789428176.728255:0:25034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789428176.728256:0:25034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789428176.728257:0:25034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789428176.728258:0:25034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789428176.728259:0:25034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789428176.728265:0:25034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789428176.728266:0:25034:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789428176.728291:0:25034:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789428176.728311:0:25034:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940198528:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789428176.728376:0:25034:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428176.728488:0:25034:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbc28300 going to sleep for 11 seconds 00000100:00100000:3.0:1789428176.728498:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940198528 00000100:00100000:3.0:1789428176.728506:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940198528 00000100:00100000:3.0:1789428176.728554:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789428176.728563:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+24:25034:x1876350940198528:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789428176.728586:0:22710:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789428176.728599:0:22710:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789428176.732270:0:22710:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789428176.732317:0:22710:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789428176.732864:0:22732:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789428176.732870:0:22732:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789428176.732890:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.732908:0:22732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685208c00/0x84fc867ede519f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519f47 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.732917:0:22732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919685208e00/0x84fc867ede519f5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519f55 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.732930:0:22732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.732969:0:22732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685208e00/0x84fc867ede519f5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede519f55 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.732983:0:22732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919685208e00/0x84fc867ede519f5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede519f55 expref: 24 pid: 22711 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428176.732997:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940198656:0@lo:104: 00000100:00100000:3.0:1789428176.733059:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789428176.733147:0:22732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919685208c00/0x84fc867ede519f4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede519f47 expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.733155:0:22732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919685208c00/0x84fc867ede519f4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede519f47 expref: 24 pid: 22711 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428176.733163:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940198784:0@lo:104: 00000100:00100000:3.0:1789428176.733186:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428176.733295:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688968050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+24:25034:x1876350940198528:12345-0@lo:253:mount.lustre.0 Request processed in 4733us (4918us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428176.733305:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789428176.733314:0:25034:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e871a47a-d8aa-4c92-86ef-047b0047c703:25034:1876350940198528:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789428176.733326:0:25034:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789428176.733330:0:25034:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789428176.733331:0:25034:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789428176.733333:0:25034:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789428176.733334:0:25034:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789428176.733335:0:25034:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789428176.733336:0:25034:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789428176.733337:0:25034:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789428176.733339:0:25034:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789428176.733340:0:25034:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789428176.733354:0:25034:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789428176.733481:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbcfa480 going to sleep for 11 seconds 00000100:00100000:1.0:1789428176.733585:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940198656 00000100:00100000:1.0:1789428176.733592:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940198656 00000100:00100000:0.0:1789428176.733640:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940198784 00000100:00100000:0.0:1789428176.733644:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940198784 00000100:00100000:0.0:1789428176.733671:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789428176.733678:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+4:22732:x1876350940198656:12345-0@lo:104: 00010000:00010000:0.0:1789428176.733691:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519f5c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.733745:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789428176.733751:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+4:22732:x1876350940198656:12345-0@lo:104: Request processed in 73us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428176.733757:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789428176.733772:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789428176.733778:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+3:22732:x1876350940198784:12345-0@lo:104: 00010000:00010000:0.0:1789428176.733787:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519f4e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.733816:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789428176.733821:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+3:22732:x1876350940198784:12345-0@lo:104: Request processed in 44us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428176.733826:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789428176.733844:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789428176.733850:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519f5c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.733857:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685208200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789428176.733861:0:23475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519f5c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.733870:0:23475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519f5c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789428176.733887:0:23475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519f5c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428176.733893:0:23475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789428176.733921:0:23475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519f5c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.733927:0:23475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789428176.733944:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519f5c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.733952:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685208200/0x84fc867ede519f55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519f5c expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.733961:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428176.733965:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519f4e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.733971:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428a00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789428176.733974:0:23475:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519f4e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.733980:0:23475:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519f4e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789428176.733987:0:23475:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519f4e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428176.733992:0:23475:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789428176.734012:0:23475:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519f4e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.734019:0:23475:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789428176.734026:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519f4e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.734032:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583428a00/0x84fc867ede519f47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519f4e expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428176.734046:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428176.734047:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428176.734049:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428176.734090:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428176.734169:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940198912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428176.734200:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.734238:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789428176.734244:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940199040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428176.734266:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428176.734292:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940198912 00000100:00100000:3.0:1789428176.734301:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940198912 00010000:00010000:3.0:1789428176.734319:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685208e00/0x84fc867ede519f5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519f55 expref: 24 pid: 22711 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428176.734340:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940199040 00000100:00100000:3.0:1789428176.734343:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940199040 00010000:00010000:3.0:1789428176.734354:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919685208c00/0x84fc867ede519f4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519f47 expref: 25 pid: 22711 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428176.734367:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789428176.734373:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+25:3615:x1876350940198912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428176.734383:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428176.734388:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685208e00/0x84fc867ede519f5c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519f55 expref: 25 pid: 22711 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734509:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685208e00/0x84fc867ede519f5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede519f55 expref: 25 pid: 22711 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734529:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428176.734560:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+25:3615:x1876350940198912:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428176.734567:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789428176.734586:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789428176.734591:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+24:3615:x1876350940199040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428176.734598:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428176.734603:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919685208c00/0x84fc867ede519f4e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519f47 expref: 24 pid: 22711 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734611:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919685208c00/0x84fc867ede519f4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede519f47 expref: 24 pid: 22711 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734632:0:22702:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734640:0:22702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789428176.734651:0:22702:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013470560s 00010000:00010000:3.0:1789428176.734656:0:22702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734663:0:22702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734669:0:22702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734674:0:22702:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734679:0:22702:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680031800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428176.734683:0:22702:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734689:0:22702:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734697:0:22702:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734705:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428176.734728:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+24:3615:x1876350940199040:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428176.734740:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789428176.734776:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940199040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428176.734784:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940198912:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428176.734813:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208e00/0x84fc867ede519f5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede519f55 expref: 23 pid: 22711 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428176.734823:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa8700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940198656:0@lo:104: 00010000:00010000:3.0:1789428176.734833:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919685208c00/0x84fc867ede519f4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede519f47 expref: 22 pid: 22711 timeout: 621 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428176.734839:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22732:1876350940198784:0@lo:104: 00010000:00010000:3.0:1789428176.734853:0:22732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734861:0:22732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734867:0:22732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428176.734872:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919680031800/0x84fc867ede51a0ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1789428176.736669:0:25034:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1789428176.740644:0:25034:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789428176.740653:0:25034:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789428176.740698:0:25034:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789428176.740743:0:25034:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.124@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789428176.740766:0:25034:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789428176.740783:0:25034:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1789428176.741539:0:25034:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789428176.741744:0:25034:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789428177.329163:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789428177.463937:0:25100:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789428177.464201:0:25100:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789428177.712779:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940199168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789428177.712851:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428177.712996:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940199168 00000100:00100000:3.0:1789428177.713005:0:24225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940199168 00000100:00100000:3.0:1789428177.713059:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789428177.713069:0:24225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940199168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789428177.713113:0:24225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789428177.713239:0:24225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940199168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428177.713248:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789428177.714203:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940199168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789428178.355638:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789428178.738360:0:22713:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789428178.738368:0:22713:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff919583218800 from 14 10000000:01000000:1.0:1789428178.738386:0:22713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789428178.738940:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1e600/0x84fc867ede51a0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.738953:0:22713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583d1e600/0x84fc867ede51a0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.738976:0:22713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583d1e600/0x84fc867ede51a0c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428178.739002:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940199296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789428178.739068:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428178.739107:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687c3b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789428178.739137:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940199296 00000100:00100000:1.0:1789428178.739143:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940199296 00000100:00100000:1.0:1789428178.739185:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789428178.739194:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+22:22713:x1876350940199296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428178.739207:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428178.739219:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1f200/0x84fc867ede51a0c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51a0c1 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.739240:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1f200/0x84fc867ede51a0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51a0c1 expref: 23 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.739249:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1f200/0x84fc867ede51a0c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51a0c1 expref: 23 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.739258:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f200, rc 0) 00000100:00100000:1.0:1789428178.739288:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688969850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+23:22713:x1876350940199296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428178.739294:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789428178.739339:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940199296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428178.739350:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583d1e600/0x84fc867ede51a0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a0c8 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.739364:0:22713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583d1e600/0x84fc867ede51a0c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51a0c8 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428178.739438:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940199424:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789428178.739477:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428178.739496:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687c3b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789428178.739508:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940199424 00000100:00100000:1.0:1789428178.739511:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940199424 00000100:00100000:1.0:1789428178.739532:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789428178.739538:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+23:22713:x1876350940199424:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789428178.739550:0:22710:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789428178.739564:0:22710:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789428178.739567:0:22710:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1789428178.739630:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+23:22713:x1876350940199424:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 92us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428178.739637:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789428178.739669:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940199424:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789428178.739720:0:22713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789428178.739726:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1e600/0x84fc867ede51a0c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a0c8 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.739734:0:22713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583d1e600/0x84fc867ede51a0c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a0c8 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428178.739743:0:22713:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789428178.739746:0:22713:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9196bbbf1000 from 14 10000000:01000000:1.0:1789428178.739752:0:22713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789428178.739766:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1ea00/0x84fc867ede51a0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.739772:0:22713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919583d1ea00/0x84fc867ede51a0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.739778:0:22713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919583d1ea00/0x84fc867ede51a0cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428178.739790:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940199552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789428178.739812:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428178.739825:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687c3b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789428178.739836:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940199552 00000100:00100000:1.0:1789428178.739840:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940199552 00000100:00100000:1.0:1789428178.739860:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789428178.739866:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+23:22713:x1876350940199552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428178.739872:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428178.739880:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1e000/0x84fc867ede51a0d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51a0cf expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.739894:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1e000/0x84fc867ede51a0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51a0cf expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.739902:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1e000/0x84fc867ede51a0d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51a0cf expref: 24 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.739907:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1e000, rc 0) 00000100:00100000:1.0:1789428178.739932:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+24:22713:x1876350940199552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428178.739945:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789428178.739979:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940199552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428178.739988:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919583d1ea00/0x84fc867ede51a0cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a0d6 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.739995:0:22713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919583d1ea00/0x84fc867ede51a0cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51a0d6 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428178.740032:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940199680:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789428178.740057:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428178.740069:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff919687c3b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789428178.740079:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940199680 00000100:00100000:1.0:1789428178.740082:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940199680 00000100:00100000:1.0:1789428178.740103:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789428178.740109:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+24:22713:x1876350940199680:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789428178.740117:0:22709:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789428178.740126:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789428178.740129:0:22709:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1789428178.740198:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+24:22713:x1876350940199680:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 89us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428178.740204:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789428178.740233:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bbbc9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940199680:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789428178.740265:0:22713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789428178.740270:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919583d1ea00/0x84fc867ede51a0cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a0d6 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.740285:0:22713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919583d1ea00/0x84fc867ede51a0cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a0d6 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428178.803775:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428163/real 1789428163] req@ffff9196bfa82680 x1876350940186880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428178 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428178.803806:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9196bfa82680 x1876350940186880/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428178 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428178.803892:0:3612:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789428163/real 1789428163] req@ffff9196bfa82d80 x1876350940187008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428178 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428178.803907:0:3612:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9196bfa82d80 x1876350940187008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789428178 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789428178.803926:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bc9e4000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789428178.803984:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789428178.803988:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940186880:0@lo:8:kworker.0 00000100:00080000:3.0:1789428178.803994:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919692afd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789428178.804084:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428178.804089:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789428178.804091:0:8:0:(import.c:65:import_set_state_nolock()) ffff9196bca11000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428178.804104:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9196bca11000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428178.804124:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bca29f80 x1876350940200064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789428178.804161:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428178.804164:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789428178.804166:0:8:0:(import.c:65:import_set_state_nolock()) ffff9196bc9e4000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428178.804170:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 507 00000100:00080000:2.0:1789428178.804175:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789428178.804180:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9196bc9e4000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428178.804191:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bca28e00 x1876350940200448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789428178.804199:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789428178.804202:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789428178.804204:0:8:0:(import.c:65:import_set_state_nolock()) ffff919692afd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789428178.804207:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 507 00000100:00080000:2.0:1789428178.804210:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789428178.804214:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff919692afd000 using connection 192.168.202.124@tcp/0@lo 00000100:00100000:2.0:1789428178.804224:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9196bca29c00 x1876350940200576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789428178.804275:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940200320:0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.804350:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.804397:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940201088:0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.804448:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.804469:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789428178.804476:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940199808:0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.804498:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.804524:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940200704:0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.804549:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.804567:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940201216:0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.804601:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.804626:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940199936:0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.804649:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.804667:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940200832:0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.804684:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.804700:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789428178.804711:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940200192:0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.804732:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.804742:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940200960:0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.804760:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.804785:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940200320 00000100:00100000:2.0:1789428178.804792:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940200320 00000100:00100000:2.0:1789428178.804830:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940199808 00000100:00100000:2.0:1789428178.804833:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940199808 00000100:00100000:2.0:1789428178.804849:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789428178.804857:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940200320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.804907:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940200320:12345-0@lo:400:kworker.0 Request processed in 50us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.804914:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789428178.804929:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789428178.804934:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940199808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.804959:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940199808:12345-0@lo:400:kworker.0 Request processed in 24us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.804973:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789428178.804991:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940201088 00000100:00100000:2.0:1789428178.804995:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940201088 00000100:00100000:2.0:1789428178.805022:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940200704 00000100:00100000:2.0:1789428178.805025:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940200704 00000100:00100000:2.0:1789428178.805033:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940201216 00000100:00100000:2.0:1789428178.805035:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940201216 00000100:00100000:2.0:1789428178.805046:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940200832 00000100:00100000:2.0:1789428178.805048:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940200832 00000100:00100000:2.0:1789428178.805058:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940200192 00000100:00100000:2.0:1789428178.805060:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940200192 00000100:00100000:2.0:1789428178.805069:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940200960 00000100:00100000:2.0:1789428178.805071:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940200960 00000100:00100000:2.0:1789428178.805086:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789428178.805092:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940201088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.805120:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1876350940201088:12345-0@lo:400:kworker.0 Request processed in 28us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.805126:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789428178.805136:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789428178.805141:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940200704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.805165:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940200704:12345-0@lo:400:kworker.0 Request processed in 24us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.805171:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789428178.805181:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789428178.805186:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940201216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.805208:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940201216:12345-0@lo:400:kworker.0 Request processed in 23us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.805214:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789428178.805229:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789428178.805235:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940200832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.805264:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940200832:12345-0@lo:400:kworker.0 Request processed in 29us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.805270:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789428178.805281:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789428178.805286:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940200192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.805308:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940200192:12345-0@lo:400:kworker.0 Request processed in 23us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.805314:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789428178.805323:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789428178.805327:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940200960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.805350:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940200960:12345-0@lo:400:kworker.0 Request processed in 22us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.805355:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789428178.805401:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940199936 00000100:00100000:2.0:1789428178.805405:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940199936 00000100:00100000:2.0:1789428178.805455:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789428178.805462:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940199936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.805491:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940199936:12345-0@lo:400:kworker.0 Request processed in 30us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.805497:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789428178.805519:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789428178.805524:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789428178.805527:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789428178.805557:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca29180 x1876350940200192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428178.805582:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940200192:0@lo:400:kworker.0 00010000:00080000:2.0:1789428178.805596:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca29500 x1876350940200960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428178.805604:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940200960:0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.805612:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940199936:0@lo:400:kworker.0 00010000:00080000:2.0:1789428178.805620:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca28380 x1876350940200832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428178.805627:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940200832:0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.805662:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940199808:0@lo:400:kworker.0 00010000:00080000:2.0:1789428178.805673:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca2a680 x1876350940200704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428178.805680:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940200704:0@lo:400:kworker.0 00010000:00080000:2.0:1789428178.805689:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca2bb80 x1876350940201216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428178.805695:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940201216:0@lo:400:kworker.0 00000100:00100000:2.0:1789428178.805705:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940200320:0@lo:400:kworker.0 00010000:00080000:2.0:1789428178.805713:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca29880 x1876350940201088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428178.805720:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3613:1876350940201088:0@lo:400:kworker.0 00000100:00080000:3.0:1789428178.805967:0:3612:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789428178.805973:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940187008:0@lo:8:kworker.0 00000100:00100000:3.0:1789428178.805994:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940200064:0@lo:8:kworker.0 00000100:00100000:3.0:1789428178.806031:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428178.806060:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940200448:0@lo:8:kworker.0 00000100:00100000:3.0:1789428178.806080:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428178.806100:0:3612:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940200576:0@lo:8:kworker.0 00000100:00100000:3.0:1789428178.806118:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.806177:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940200064 00000100:00100000:2.0:1789428178.806186:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940200064 00000100:00100000:2.0:1789428178.806199:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940200448 00000100:00100000:2.0:1789428178.806201:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940200448 00000100:00100000:2.0:1789428178.806207:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940200576 00000100:00100000:2.0:1789428178.806209:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940200576 00000100:00100000:2.0:1789428178.806217:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789428178.806222:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3612:x1876350940200064:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789428178.806247:0:24222:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1789428178.806274:0:24222:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x84fc867ede51a0dd 00002000:00100000:2.0:1789428178.806287:0:24222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9195827bb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789428178.806291:0:24222:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789428178.806294:0:24222:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789428178.806510:0:24222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789428178.806531:0:24222:0:(import.c:65:import_set_state_nolock()) ffff9195827b9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428178.806574:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3612:x1876350940200064:12345-0@lo:8:kworker.0 Request processed in 351us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.806581:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789428178.806595:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789428178.806599:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3612:x1876350940200448:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789428178.806613:0:24222:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1789428178.806625:0:24222:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede51a0e4 00002000:00100000:2.0:1789428178.806631:0:24222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9195827bc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789428178.806634:0:24222:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1789428178.806636:0:24222:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789428178.806672:0:24222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789428178.806684:0:24222:0:(import.c:65:import_set_state_nolock()) ffff9195827b9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428178.806711:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3612:x1876350940200448:12345-0@lo:8:kworker.0 Request processed in 110us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.806722:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789428178.806733:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789428178.806737:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3612:x1876350940200576:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789428178.806752:0:24222:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1789428178.806767:0:24222:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x84fc867ede51a0eb 00002000:00100000:2.0:1789428178.806773:0:24222:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9195827bf000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a29 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789428178.806776:0:24222:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789428178.806778:0:24222:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789428178.806798:0:24222:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789428178.806809:0:24222:0:(import.c:65:import_set_state_nolock()) ffff9195827ba800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789428178.806834:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3612:x1876350940200576:12345-0@lo:8:kworker.0 Request processed in 96us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.806840:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789428178.806938:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca29f80 x1876350940200064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789428203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789428178.806950:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789428178.806962:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789428178.806967:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789428178.806970:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bca11000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789428178.806982:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789428178.806988:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3612:1876350940200064:0@lo:8:kworker.0 00000100:00100000:3.0:1789428178.807001:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789428178.807006:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789428178.807010:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789428178.807012:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789428178.807013:0:3612:0:(import.c:65:import_set_state_nolock()) ffff9196bc9e4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789428178.807020:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789428178.807023:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940200448:0@lo:8:kworker.0 00010000:00080000:3.0:1789428178.807032:0:3612:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bca29c00 x1876350940200576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789428198 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428178.807039:0:3612:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789428178.807042:0:3612:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789428178.807046:0:3612:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789428178.807048:0:3612:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789428178.807050:0:3612:0:(import.c:65:import_set_state_nolock()) ffff919692afd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789428178.807060:0:3612:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789428178.807062:0:3612:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3612:1876350940200576:0@lo:8:kworker.0 00000004:00080000:3.0:1789428178.807086:0:22742:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789428178.807150:0:22742:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 523301734043ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789428178.807157:0:22742:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1789428178.807249:0:22743:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1789428178.807266:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22743:1876350940201472:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789428178.807292:0:22743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.807307:0:22743:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d840 going to sleep for 11 seconds 00000004:00080000:2.0:1789428178.807329:0:23459:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789428178.807342:0:23459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23459:1876350940201728:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1789428178.807386:0:23459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.807401:0:23459:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968886d180 going to sleep for 11 seconds 00000004:00080000:2.0:1789428178.807428:0:23458:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789428178.807471:0:23458:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 523302055725ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789428178.807476:0:23458:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1789428178.807523:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940201344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789428178.807553:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428178.807576:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789428178.807582:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940201600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789428178.807604:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428178.807633:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940201344 00000100:00100000:1.0:1789428178.807638:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940201344 00000100:00100000:1.0:1789428178.807670:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940201600 00000100:00100000:1.0:1789428178.807673:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940201600 00000100:00100000:1.0:1789428178.807688:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789428178.807695:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bbbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940201344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789428178.807715:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789428178.807752:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bbbc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940201344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428178.807758:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789428178.807778:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789428178.807783:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3615:x1876350940201600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789428178.807793:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789428178.807815:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3615:x1876350940201600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428178.807821:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789428178.807838:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789428178.807841:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789428178.807871:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940201600:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789428178.807880:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f6680 x1876350940201344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789428194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428178.807889:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940201344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789428178.808126:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940201472 00000100:00100000:0.0:1789428178.808131:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940201472 00000100:00100000:0.0:1789428178.808163:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940201728 00000100:00100000:0.0:1789428178.808166:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940201728 00000100:00100000:0.0:1789428178.808180:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789428178.808187:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22743:x1876350940201472:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789428178.810015:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940201856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789428178.810079:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789428178.810132:0:23461:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1789428178.810154:0:23461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23461:1876350940201984:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789428178.810185:0:23461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428178.810200:0:23461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adb37b40 going to sleep for 11 seconds 00000004:00080000:3.0:1789428178.810214:0:23460:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789428178.810281:0:23460:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 523304865749ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789428178.810288:0:23460:0:(osd_handler.c:2851:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1789428178.810662:0:24222:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789428178.810671:0:24222:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789428178.810800:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940201984 00000100:00100000:0.0:1789428178.810806:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940201984 00000100:00100000:0.0:1789428178.810913:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789428178.810923:0:25188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23459:x1876350940201728:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789428178.812558:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940201856 00000100:00100000:0.0:1789428178.812571:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940201856 00000100:00100000:0.0:1789428178.812613:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789428178.812621:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3613:x1876350940201856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789428178.812639:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915857920 avail 3684335616 00000004:00080000:2.0:1789428178.813370:0:22696:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789428178.813460:0:23449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:2.0:1789428178.813466:0:23449:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1789428178.817793:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3613:x1876350940201856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5162us (7703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428178.817807:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789428178.817849:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:0.0:1789428178.817864:0:25188:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789428178.817870:0:25188:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1789428178.817941:0:25188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23459:x1876350940201728:12345-0@lo:7:osp-pre-0-1.0 Request processed in 7020us (10555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428178.817949:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789428178.817993:0:23459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23459:1876350940201728:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789428178.818007:0:23459:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1789428178.818044:0:23459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23459:1876350940202112:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789428178.818074:0:23459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428178.818094:0:23459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834bec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789428178.818108:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940202112 00000100:00100000:0.0:1789428178.818114:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940202112 00000100:00100000:0.0:1789428178.818145:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789428178.818154:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23461:x1876350940201984:12345-0@lo:7:osp-pre-1-1.0 00010000:00080000:1.0:1789428178.818541:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfaa9f80 x1876350940201856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789428194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428178.818560:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940201856:0@lo:13:osp-pre-1-1.0 00002000:00080000:3.0:1789428178.820970:0:24220:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1789428178.820980:0:24220:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1789428178.820986:0:24220:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:0.0:1789428178.825481:0:24222:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789428178.825492:0:24222:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789428178.825601:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23461:x1876350940201984:12345-0@lo:7:osp-pre-1-1.0 Request processed in 7444us (15411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428178.825616:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789428178.825656:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789428178.825666:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23459:x1876350940202112:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789428178.825693:0:24222:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1789428178.825723:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23459:x1876350940202112:12345-0@lo:5:osp-pre-0-1.0 Request processed in 61us (7648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428178.825728:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789428178.825769:0:23461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfaa9c00 x1876350940201984/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789428194 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428178.825783:0:23461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23461:1876350940201984:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789428178.825794:0:23461:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789428178.825829:0:23461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23461:1876350940202240:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789428178.825858:0:23461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428178.825877:0:23461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834be000 going to sleep for 11 seconds 00000100:00100000:0.0:1789428178.825895:0:23459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23459:1876350940202112:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789428178.825903:0:23459:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1789428178.825922:0:23459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23459:1876350940202368:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789428178.825939:0:23459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428178.825953:0:23459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834bec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789428178.825965:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940202240 00000100:00100000:0.0:1789428178.825969:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940202240 00000100:00100000:0.0:1789428178.825991:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940202368 00000100:00100000:0.0:1789428178.825994:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940202368 00000100:00100000:0.0:1789428178.826003:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789428178.826008:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23461:x1876350940202240:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789428178.826018:0:24221:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1789428178.826047:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23461:x1876350940202240:12345-0@lo:5:osp-pre-1-1.0 Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428178.826053:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789428178.826064:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789428178.826069:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23459:x1876350940202368:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789428178.826090:0:24221:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00010000:00080000:0.0:1789428178.826239:0:23461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bfb8c000 x1876350940202240/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789428194 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428178.826250:0:23461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23461:1876350940202240:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789428178.826256:0:23461:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789428178.826274:0:23461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23461:1876350940202496:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789428178.826293:0:23461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428178.826300:0:23461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834be000 going to sleep for 11 seconds 00000100:00100000:0.0:1789428178.826311:0:24222:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789428178.826316:0:24222:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789428178.826452:0:25188:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789428178.826461:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940202496 00000100:00100000:0.0:1789428178.826465:0:25188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940202496 00000100:00100000:2.0:1789428178.827948:0:25192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789428178.827961:0:25192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23461:x1876350940202496:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789428178.827992:0:25192:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:3.0:1789428178.838832:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428178.838846:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8d76b52/0x84fc867ede51a0f2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.838863:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1789428178.838868:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428178.838874:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8d76b52/0x84fc867ede51a0f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.838894:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8d76b52/0x84fc867ede51a0f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.838904:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8d76b52/0x84fc867ede51a0f2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.838911:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8d76b52/0x84fc867ede51a0f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.839137:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789428178.842900:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789428178.842913:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede51a0f9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.842930:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1789428178.842935:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428178.842941:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede51a0f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.842955:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede51a0f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.842965:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede51a0f9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428178.842973:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede51a0f9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.844914:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789428178.844927:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8d76b52/0x84fc867ede51a0f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.844939:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680031800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428178.844944:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8d76b52/0x84fc867ede51a0f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.844953:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8d76b52/0x84fc867ede51a0f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.844980:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8d76b52/0x84fc867ede51a0f2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.844987:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8d76b52/0x84fc867ede51a0f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.845007:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428178.845011:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede51a0f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.845016:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1f600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428178.845019:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede51a0f9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.845026:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede51a0f9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.845035:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede51a0f9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.845042:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428178.845044:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428178.845046:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428178.848211:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789428178.848225:0:24220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd478328/0x84fc867ede51a0f9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.848711:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428178.849455:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428178.849465:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f69f5a4/0x84fc867ede51a100 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.849481:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1789428178.849486:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428178.849494:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f69f5a4/0x84fc867ede51a100 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.849510:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f69f5a4/0x84fc867ede51a100 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.849520:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f69f5a4/0x84fc867ede51a100 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.849527:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f69f5a4/0x84fc867ede51a100 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.849544:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789428178.849947:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428178.849953:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa27744b/0x84fc867ede51a107 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.849962:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1789428178.849965:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428178.849970:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa27744b/0x84fc867ede51a107 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.849990:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa27744b/0x84fc867ede51a107 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.849998:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa27744b/0x84fc867ede51a107 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850006:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa27744b/0x84fc867ede51a107 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850022:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789428178.850103:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789428178.850110:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f69f5a4/0x84fc867ede51a100 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850119:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680030800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428178.850123:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f69f5a4/0x84fc867ede51a100 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850133:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f69f5a4/0x84fc867ede51a100 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850150:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f69f5a4/0x84fc867ede51a100 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850158:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f69f5a4/0x84fc867ede51a100 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850182:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428178.850185:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa27744b/0x84fc867ede51a107 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850192:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680031200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428178.850195:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa27744b/0x84fc867ede51a107 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850203:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa27744b/0x84fc867ede51a107 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850213:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa27744b/0x84fc867ede51a107 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850220:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa27744b/0x84fc867ede51a107 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850232:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428178.850233:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428178.850235:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428178.850757:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428178.850892:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428178.850899:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb09a52c/0x84fc867ede51a10e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850909:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1789428178.850919:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428178.850924:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb09a52c/0x84fc867ede51a10e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850934:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb09a52c/0x84fc867ede51a10e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850942:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb09a52c/0x84fc867ede51a10e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850950:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb09a52c/0x84fc867ede51a10e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.850970:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428178.851176:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428178.851182:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb09a52c/0x84fc867ede51a10e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.851195:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680030000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428178.851199:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb09a52c/0x84fc867ede51a10e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.851207:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb09a52c/0x84fc867ede51a10e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.851220:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb09a52c/0x84fc867ede51a10e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.851227:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb09a52c/0x84fc867ede51a10e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.851242:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428178.851244:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428178.851246:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428178.851308:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428178.851313:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000973575ee/0x84fc867ede51a115 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.851321:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1789428178.851324:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428178.851328:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000973575ee/0x84fc867ede51a115 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.851336:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000973575ee/0x84fc867ede51a115 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.851345:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000973575ee/0x84fc867ede51a115 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.851358:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000973575ee/0x84fc867ede51a115 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.851384:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428178.851932:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428178.851938:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000973575ee/0x84fc867ede51a115 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.851947:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680030600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428178.851950:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000973575ee/0x84fc867ede51a115 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.851959:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000973575ee/0x84fc867ede51a115 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.851977:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000973575ee/0x84fc867ede51a115 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.851984:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000973575ee/0x84fc867ede51a115 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.851999:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428178.852000:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428178.852002:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428178.852239:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428178.852245:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f93b784b/0x84fc867ede51a11c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.852254:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1789428178.852258:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428178.852262:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f93b784b/0x84fc867ede51a11c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.852271:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f93b784b/0x84fc867ede51a11c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.852280:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f93b784b/0x84fc867ede51a11c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.852288:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f93b784b/0x84fc867ede51a11c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.852308:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428178.852854:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428178.852860:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f93b784b/0x84fc867ede51a11c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.852869:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428178.852873:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f93b784b/0x84fc867ede51a11c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.852881:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f93b784b/0x84fc867ede51a11c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.852893:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f93b784b/0x84fc867ede51a11c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.852900:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f93b784b/0x84fc867ede51a11c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.852926:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428178.852928:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428178.852930:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789428178.853160:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789428178.853166:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede51a123 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.853181:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=523s v=(0 0) 00010000:00010000:3.0:1789428178.853185:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428178.853190:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede51a123 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.853200:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede51a123 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.853207:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede51a123 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.853215:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede51a123 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.853461:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789428178.859525:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428178.859538:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede51a123 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.859553:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429c00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428178.859558:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede51a123 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.859570:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede51a123 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.859662:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede51a123 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.859670:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000654ab2d9/0x84fc867ede51a123 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.859694:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428178.859696:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428178.859698:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428178.859836:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.859844:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a12a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.859856:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.859861:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.859867:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a12a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.859879:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a12a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.859888:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a12a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.859896:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a12a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.859951:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789428178.861510:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.861521:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a131 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.861545:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.861549:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.861554:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a131 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.861566:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a131 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.861683:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a131 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.861693:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a131 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.865736:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789428178.865751:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a12a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.865777:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375d800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428178.865782:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a12a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.865794:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a12a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.865815:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a12a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.865824:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a12a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.865842:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428178.865846:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a131 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.865852:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375d400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:0.0:1789428178.865855:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a131 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.865862:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a131 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.865871:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a131 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.865885:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428178.865887:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428178.865888:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.866310:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789428178.866320:0:24220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a131 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.866719:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428178.871001:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428178.871013:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a4f1112/0x84fc867ede51a138 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.871031:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1789428178.871036:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428178.871043:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a4f1112/0x84fc867ede51a138 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.871057:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a4f1112/0x84fc867ede51a138 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.871068:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a4f1112/0x84fc867ede51a138 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.871077:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a4f1112/0x84fc867ede51a138 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.871101:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428178.871580:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428178.871588:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a4f1112/0x84fc867ede51a138 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.871597:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965c00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.871602:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a4f1112/0x84fc867ede51a138 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.871622:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a4f1112/0x84fc867ede51a138 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.871640:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a4f1112/0x84fc867ede51a138 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.871649:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a4f1112/0x84fc867ede51a138 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.871668:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.871670:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.871671:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789428178.871919:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789428178.871925:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cdbcd20/0x84fc867ede51a13f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.871945:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1789428178.871948:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789428178.871953:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cdbcd20/0x84fc867ede51a13f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.871963:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cdbcd20/0x84fc867ede51a13f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.871971:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cdbcd20/0x84fc867ede51a13f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.871979:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cdbcd20/0x84fc867ede51a13f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428178.872003:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789428178.872191:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428178.872198:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cdbcd20/0x84fc867ede51a13f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.872207:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428178.872210:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cdbcd20/0x84fc867ede51a13f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.872218:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cdbcd20/0x84fc867ede51a13f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.872241:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cdbcd20/0x84fc867ede51a13f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.872249:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cdbcd20/0x84fc867ede51a13f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.872263:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428178.872265:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428178.872267:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428178.875539:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.875550:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a146 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.875566:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.875570:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.875576:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a146 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.875588:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a146 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.875596:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a146 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.875608:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a146 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.875631:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789428178.875869:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.875875:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002519f405/0x84fc867ede51a14d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.875883:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.875886:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.875891:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002519f405/0x84fc867ede51a14d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.875899:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002519f405/0x84fc867ede51a14d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.875907:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002519f405/0x84fc867ede51a14d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.875915:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002519f405/0x84fc867ede51a14d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.875929:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789428178.876135:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.876141:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007793499f/0x84fc867ede51a154 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.876155:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.876158:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.876162:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007793499f/0x84fc867ede51a154 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.876171:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007793499f/0x84fc867ede51a154 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.876180:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007793499f/0x84fc867ede51a154 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.876188:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007793499f/0x84fc867ede51a154 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.876204:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789428178.876486:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.876492:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8a00241/0x84fc867ede51a15b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.876501:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.876504:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.876508:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8a00241/0x84fc867ede51a15b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.876518:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8a00241/0x84fc867ede51a15b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877512:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8a00241/0x84fc867ede51a15b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877524:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8a00241/0x84fc867ede51a15b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877533:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1789428178.877645:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789428178.877652:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a146 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877660:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375d400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.877665:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a146 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877674:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a146 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877691:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a146 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877698:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed610261/0x84fc867ede51a146 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877715:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789428178.877724:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002519f405/0x84fc867ede51a14d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877730:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.877733:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002519f405/0x84fc867ede51a14d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877740:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002519f405/0x84fc867ede51a14d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877748:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002519f405/0x84fc867ede51a14d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877754:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002519f405/0x84fc867ede51a14d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877763:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789428178.877766:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007793499f/0x84fc867ede51a154 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877771:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.877774:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007793499f/0x84fc867ede51a154 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877779:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007793499f/0x84fc867ede51a154 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877796:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007793499f/0x84fc867ede51a154 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877802:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007793499f/0x84fc867ede51a154 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877812:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428178.877814:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8a00241/0x84fc867ede51a15b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877819:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.877822:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8a00241/0x84fc867ede51a15b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877829:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8a00241/0x84fc867ede51a15b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877835:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8a00241/0x84fc867ede51a15b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877841:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8a00241/0x84fc867ede51a15b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.877849:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.877851:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.877856:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.877862:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428178.878082:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.878088:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3ddf0c5/0x84fc867ede51a162 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878097:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.878100:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.878105:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3ddf0c5/0x84fc867ede51a162 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878114:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3ddf0c5/0x84fc867ede51a162 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878121:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3ddf0c5/0x84fc867ede51a162 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878128:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3ddf0c5/0x84fc867ede51a162 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878140:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789428178.878347:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.878352:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cedaa2d3/0x84fc867ede51a169 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878360:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.878362:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.878366:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cedaa2d3/0x84fc867ede51a169 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878391:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cedaa2d3/0x84fc867ede51a169 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878399:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cedaa2d3/0x84fc867ede51a169 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878406:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cedaa2d3/0x84fc867ede51a169 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878483:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789428178.878720:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.878725:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede51a170 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878732:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.878735:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.878738:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede51a170 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878747:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede51a170 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878754:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede51a170 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878772:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede51a170 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.878779:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789428178.879548:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.879556:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede51a177 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.879565:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.879568:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.879573:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede51a177 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.879582:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede51a177 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.879589:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede51a177 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.879596:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede51a177 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.879603:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1789428178.880274:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.880282:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede51a17e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880299:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.880302:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.880306:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede51a17e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880316:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede51a17e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880325:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede51a17e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880332:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede51a17e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880341:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:2.0:1789428178.880810:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789428178.880817:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3ddf0c5/0x84fc867ede51a162 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880825:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.880829:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3ddf0c5/0x84fc867ede51a162 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880838:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3ddf0c5/0x84fc867ede51a162 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880867:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3ddf0c5/0x84fc867ede51a162 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880875:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3ddf0c5/0x84fc867ede51a162 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880893:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789428178.880898:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cedaa2d3/0x84fc867ede51a169 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880904:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375ca00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.880908:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cedaa2d3/0x84fc867ede51a169 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880915:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cedaa2d3/0x84fc867ede51a169 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880925:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cedaa2d3/0x84fc867ede51a169 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880933:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cedaa2d3/0x84fc867ede51a169 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880944:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789428178.880948:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede51a170 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880960:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375d600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.880963:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede51a170 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880971:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede51a170 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880981:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede51a170 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.880989:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8cbd018/0x84fc867ede51a170 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881002:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789428178.881005:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede51a177 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881012:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375de00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.881015:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede51a177 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881022:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede51a177 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881031:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede51a177 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881044:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093b35f29/0x84fc867ede51a177 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881057:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428178.881060:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede51a17e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881068:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375d000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.881071:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede51a17e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881078:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede51a17e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881088:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede51a17e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881095:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e745ac90/0x84fc867ede51a17e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881107:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.881109:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.881111:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.881119:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428178.881806:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.881820:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51a185 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881831:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.881835:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.881840:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51a185 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881851:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51a185 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881860:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51a185 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881869:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51a185 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.881885:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428178.881999:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428178.882005:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51a185 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.882012:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375cc00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.882016:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51a185 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.882024:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51a185 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.882041:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51a185 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.882049:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a792cd01/0x84fc867ede51a185 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.882062:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.882064:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.882066:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789428178.882463:0:24217:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1789428178.882473:0:24217:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789428178.882731:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:23459:x1876350940202368:12345-0@lo:5:osp-pre-0-1.0 Request processed in 56657us (56785us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789428178.882742:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00002000:00010000:2.0:1789428178.882811:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.882818:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083ee667f/0x84fc867ede51a18c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.882828:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.882832:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.882836:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083ee667f/0x84fc867ede51a18c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.882847:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083ee667f/0x84fc867ede51a18c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.882857:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083ee667f/0x84fc867ede51a18c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.882876:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083ee667f/0x84fc867ede51a18c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.882890:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428178.883005:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428178.883011:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083ee667f/0x84fc867ede51a18c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883019:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375dc00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.883022:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083ee667f/0x84fc867ede51a18c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883031:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083ee667f/0x84fc867ede51a18c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883044:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083ee667f/0x84fc867ede51a18c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883051:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083ee667f/0x84fc867ede51a18c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883066:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.883068:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.883070:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428178.883264:0:23459:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1789428178.883273:0:23459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23459:1876350940202368:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789428178.883290:0:23459:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1789428178.883344:0:23459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23459:1876350940202624:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789428178.883402:0:23459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428178.883459:0:23459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196834bec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789428178.883584:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940202624 00000100:00100000:2.0:1789428178.883597:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940202624 00000100:00100000:2.0:1789428178.883637:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789428178.883646:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23459:x1876350940202624:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789428178.883697:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23459:x1876350940202624:12345-0@lo:900:osp-pre-0-1.0 Request processed in 52us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.883704:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00002000:00010000:2.0:1789428178.883759:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.883764:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede51a193 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883773:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.883776:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.883781:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede51a193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883790:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede51a193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883798:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede51a193 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883805:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede51a193 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883818:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428178.883918:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428178.883923:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede51a193 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883936:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375c400 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.883939:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede51a193 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883947:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede51a193 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883961:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede51a193 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883968:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000566ba7/0x84fc867ede51a193 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.883984:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.883986:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.883988:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428178.884322:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.884329:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51a19a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884337:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.884340:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.884344:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51a19a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884353:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51a19a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884367:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51a19a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884387:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51a19a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884405:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789428178.884518:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428178.884524:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51a19a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884531:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375da00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.884535:0:22705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51a19a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884542:0:22705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51a19a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884552:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51a19a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884559:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb8d9332/0x84fc867ede51a19a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884571:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.884577:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.884579:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428178.884802:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.884808:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a1a1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884816:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.884820:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.884823:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a1a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884831:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a1a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884840:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a1a1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884848:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a1a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.884861:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:1.0:1789428178.885169:0:23459:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91958444fb80 x1876350940202624/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789428194 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428178.885184:0:23459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23459:1876350940202624:0@lo:900:osp-pre-0-1.0 00002000:00010000:2.0:1789428178.885280:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.885286:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000de8cb4a/0x84fc867ede51a1a8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.885296:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.885300:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.885305:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000de8cb4a/0x84fc867ede51a1a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.885320:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000de8cb4a/0x84fc867ede51a1a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.885330:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000de8cb4a/0x84fc867ede51a1a8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.885339:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000de8cb4a/0x84fc867ede51a1a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.885353:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789428178.885715:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.885721:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099768912/0x84fc867ede51a1af lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.885730:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.885733:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.885737:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099768912/0x84fc867ede51a1af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.885746:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099768912/0x84fc867ede51a1af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.885753:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000099768912/0x84fc867ede51a1af lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.885770:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099768912/0x84fc867ede51a1af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.885778:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789428178.886045:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789428178.886052:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a1a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886062:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91958375d800 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428178.886066:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a1a1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886074:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a1a1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886089:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a1a1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886097:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000983e2678/0x84fc867ede51a1a1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886126:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789428178.886129:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000de8cb4a/0x84fc867ede51a1a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886136:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428178.886139:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000de8cb4a/0x84fc867ede51a1a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886147:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000de8cb4a/0x84fc867ede51a1a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886157:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000de8cb4a/0x84fc867ede51a1a8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886165:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000de8cb4a/0x84fc867ede51a1a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886177:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789428178.886180:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099768912/0x84fc867ede51a1af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886186:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ece00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428178.886190:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099768912/0x84fc867ede51a1af lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886207:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099768912/0x84fc867ede51a1af lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886217:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099768912/0x84fc867ede51a1af lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886224:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099768912/0x84fc867ede51a1af lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428178.886237:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428178.886238:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789428178.886240:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789428178.886555:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.886561:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd30a48b/0x84fc867ede51a1b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.886570:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.886573:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.886577:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd30a48b/0x84fc867ede51a1b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.886586:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd30a48b/0x84fc867ede51a1b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.886594:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd30a48b/0x84fc867ede51a1b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.886602:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd30a48b/0x84fc867ede51a1b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.886620:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789428178.886893:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.886899:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab1c9f31/0x84fc867ede51a1bd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.886912:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.886915:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.886920:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab1c9f31/0x84fc867ede51a1bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.886929:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab1c9f31/0x84fc867ede51a1bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.886938:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab1c9f31/0x84fc867ede51a1bd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.886946:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab1c9f31/0x84fc867ede51a1bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.886955:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789428178.887583:0:24220:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789428178.887589:0:24220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a1c4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.887599:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1789428178.887602:0:24220:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428178.887607:0:24220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a1c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.887616:0:24220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a1c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.887634:0:24220:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a1c4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.887642:0:24220:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a1c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.887650:0:24220:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:2.0:1789428178.887682:0:24220:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:2.0:1789428178.887772:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22743:x1876350940201472:12345-0@lo:5:osp-pre-1-0.0 Request processed in 79582us (80476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428178.887780:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789428178.887836:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22743:1876350940201472:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789428178.887849:0:22743:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1789428178.887892:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22743:1876350940202752:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789428178.887922:0:22743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.887954:0:22743:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25e480 going to sleep for 11 seconds 00010000:00010000:2.0:1789428178.887970:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789428178.887976:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd30a48b/0x84fc867ede51a1b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.887984:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ede00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.887988:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd30a48b/0x84fc867ede51a1b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888008:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd30a48b/0x84fc867ede51a1b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888022:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd30a48b/0x84fc867ede51a1b6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888030:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd30a48b/0x84fc867ede51a1b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888044:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789428178.888047:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab1c9f31/0x84fc867ede51a1bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888053:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec000 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.888055:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab1c9f31/0x84fc867ede51a1bd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888062:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab1c9f31/0x84fc867ede51a1bd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888071:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab1c9f31/0x84fc867ede51a1bd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888078:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab1c9f31/0x84fc867ede51a1bd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888101:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789428178.888104:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a1c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888110:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428178.888113:0:22704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a1c4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888120:0:22704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a1c4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888130:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a1c4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888136:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a1c4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428178.888146:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.888148:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.888149:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428178.888156:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428178.888166:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940202752 00000100:00100000:2.0:1789428178.888172:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940202752 00000100:00100000:2.0:1789428178.888214:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789428178.888224:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22743:x1876350940202752:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789428178.888263:0:24222:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:3.0:1789428178.888470:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789428178.888912:0:25035:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1789428178.888935:0:25035:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789428178.888940:0:25035:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789428178.889105:0:25192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:23461:x1876350940202496:12345-0@lo:5:osp-pre-1-1.0 Request processed in 61145us (62808us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1789428178.889114:0:25192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789428178.889194:0:23461:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1789428178.889202:0:23461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23461:1876350940202496:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789428178.889214:0:23461:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1789428178.889250:0:23461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23461:1876350940202880:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789428178.889281:0:23461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428178.889309:0:23461:0:(client.c:2716:ptlrpc_set_wait()) set ffff91968b25e600 going to sleep for 11 seconds 00000100:00100000:1.0:1789428178.889359:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940202880 00000100:00100000:1.0:1789428178.889365:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940202880 00000100:00100000:1.0:1789428178.889442:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789428178.889451:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23461:x1876350940202880:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1789428178.889494:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23461:x1876350940202880:12345-0@lo:900:osp-pre-1-1.0 Request processed in 45us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428178.889506:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789428178.889589:0:23461:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196bf9f5180 x1876350940202880/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789428194 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789428178.889599:0:23461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23461:1876350940202880:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789428178.896770:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22743:1876350940202752:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789428178.896791:0:22743:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:3.0:1789428178.897005:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22743:x1876350940202752:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7193us (7492us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1789428178.897017:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789428179.249549:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789428179.249575:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940203008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789428179.249646:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428179.249743:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940203008 00000100:00100000:1.0:1789428179.249752:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940203008 00000100:00100000:1.0:1789428179.249806:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789428179.249816:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940203008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789428179.249848:0:22721:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789428179.249892:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940203008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428179.249898:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789428179.249987:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940203008:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789428179.376524:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428179.762385:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789428179.762406:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940203136:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789428179.762491:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428179.762713:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940203136 00000100:00100000:3.0:1789428179.762721:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940203136 00000100:00100000:3.0:1789428179.762778:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789428179.762787:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940203136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789428179.762818:0:22722:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789428179.762873:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940203136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428179.762881:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789428179.763281:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940203136:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789428180.400550:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428181.424699:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789428182.255577:0:25392:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789428182.450488:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428182.833743:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940203264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789428182.833815:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428182.833936:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940203264 00000100:00100000:2.0:1789428182.833944:0:24225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940203264 00000100:00100000:2.0:1789428182.834014:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789428182.834025:0:24225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940203264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789428182.834055:0:24225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00080000:0.0:1789428182.834120:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789428182.834186:0:24225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940203264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 162us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428182.834194:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789428182.834261:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940203264:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1789428183.010664:0:25444:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789428183.010861:0:25444:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789428183.475239:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789428183.818803:0:25494:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789428183.819074:0:25494:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789428183.857746:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e871a47a-d8aa-4c92-86ef-047b0047c703:3613:1876350940203392:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.857817:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428183.857865:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940203904:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.857890:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428183.857920:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940204416:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.857942:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428183.857958:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940204928:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.857982:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428183.858004:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789428183.858010:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940203520:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858031:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428183.858050:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940204032:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858067:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428183.858084:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940204544:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858104:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428183.858130:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940203648:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858153:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428183.858178:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940204160:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858195:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428183.858209:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940204672:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858230:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428183.858241:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789428183.858245:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940203776:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858263:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428183.858286:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940204288:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858304:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428183.858319:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940204800:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858356:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428183.858395:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940203392 00000100:00100000:0.0:1789428183.858404:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940203392 00000100:00100000:0.0:1789428183.858471:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789428183.858480:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+24:3613:x1876350940203392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858529:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+24:3613:x1876350940203392:12345-0@lo:400:kworker.0 Request processed in 50us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428183.858536:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789428183.858568:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940203904 00000100:00100000:0.0:1789428183.858571:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940203904 00000100:00100000:0.0:1789428183.858589:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940204416 00000100:00100000:0.0:1789428183.858592:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940204416 00000100:00100000:0.0:1789428183.858604:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940204928 00000100:00100000:0.0:1789428183.858606:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940204928 00000100:00100000:0.0:1789428183.858625:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940204544 00000100:00100000:0.0:1789428183.858628:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940204544 00000100:00100000:0.0:1789428183.858639:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940204672 00000100:00100000:0.0:1789428183.858641:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940204672 00000100:00100000:0.0:1789428183.858651:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940204800 00000100:00100000:0.0:1789428183.858653:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940204800 00000100:00100000:0.0:1789428183.858665:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789428183.858671:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940203904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858701:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1876350940203904:12345-0@lo:400:kworker.0 Request processed in 30us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428183.858707:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789428183.858719:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789428183.858725:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940204416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858750:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1876350940204416:12345-0@lo:400:kworker.0 Request processed in 25us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428183.858756:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789428183.858777:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789428183.858782:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940204928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858811:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1876350940204928:12345-0@lo:400:kworker.0 Request processed in 28us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428183.858816:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789428183.858827:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789428183.858833:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940204544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858857:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1876350940204544:12345-0@lo:400:kworker.0 Request processed in 25us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428183.858862:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789428183.858872:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789428183.858877:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940204672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858907:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1876350940204672:12345-0@lo:400:kworker.0 Request processed in 30us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428183.858913:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789428183.858923:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789428183.858929:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940204800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.858971:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1876350940204800:12345-0@lo:400:kworker.0 Request processed in 42us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428183.858978:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789428183.859004:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940203520 00000100:00100000:0.0:1789428183.859008:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940203520 00000100:00100000:0.0:1789428183.859032:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940204032 00000100:00100000:0.0:1789428183.859035:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940204032 00000100:00100000:0.0:1789428183.859049:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789428183.859054:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940203520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.859094:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940203520:12345-0@lo:400:kworker.0 Request processed in 39us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428183.859099:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789428183.859110:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789428183.859116:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940204032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.859138:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940204032:12345-0@lo:400:kworker.0 Request processed in 23us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428183.859143:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789428183.859167:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789428183.859171:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789428183.859200:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583fca300 x1876350940204800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428183.859214:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3615:1876350940204800:0@lo:400:kworker.0 00010000:00080000:0.0:1789428183.859224:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583fcb100 x1876350940204672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428183.859233:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3615:1876350940204672:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.859259:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940203520:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.859268:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940204032:0@lo:400:kworker.0 00010000:00080000:0.0:1789428183.859276:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583fca680 x1876350940204544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428183.859284:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3613:1876350940204544:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.859291:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e871a47a-d8aa-4c92-86ef-047b0047c703:3613:1876350940203392:0@lo:400:kworker.0 00010000:00080000:0.0:1789428183.859300:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583fc8e00 x1876350940203904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428183.859316:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3613:1876350940203904:0@lo:400:kworker.0 00010000:00080000:0.0:1789428183.859340:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583fcad80 x1876350940204416/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428183.859347:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3613:1876350940204416:0@lo:400:kworker.0 00010000:00080000:0.0:1789428183.859357:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919583fcb800 x1876350940204928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428183.859364:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3613:1876350940204928:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.859733:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940203648 00000100:00100000:0.0:1789428183.859738:0:25188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940203648 00000100:00100000:0.0:1789428183.859767:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940204160 00000100:00100000:0.0:1789428183.859770:0:25188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940204160 00000100:00100000:0.0:1789428183.859788:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940203776 00000100:00100000:0.0:1789428183.859791:0:25188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940203776 00000100:00100000:0.0:1789428183.859803:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940204288 00000100:00100000:0.0:1789428183.859805:0:25188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940204288 00000100:00100000:0.0:1789428183.859819:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789428183.859825:0:25188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940203648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.859868:0:25188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940203648:12345-0@lo:400:kworker.0 Request processed in 42us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428183.859874:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789428183.859886:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789428183.859892:0:25188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940204160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.859916:0:25188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940204160:12345-0@lo:400:kworker.0 Request processed in 25us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428183.859921:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789428183.859939:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789428183.859945:0:25188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940203776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.859972:0:25188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1876350940203776:12345-0@lo:400:kworker.0 Request processed in 28us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428183.859978:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789428183.859988:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789428183.859994:0:25188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940204288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.860020:0:25188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940204288:12345-0@lo:400:kworker.0 Request processed in 26us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428183.860024:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789428183.860042:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789428183.860045:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789428183.860063:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940203776:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.860073:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940204288:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.860083:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfb8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940203648:0@lo:400:kworker.0 00000100:00100000:0.0:1789428183.860092:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940204160:0@lo:400:kworker.0 00000100:00100000:1.0:1789428183.860454:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940205056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789428183.860491:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428183.860526:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940205056 00000100:00100000:1.0:1789428183.860530:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940205056 00000100:00100000:1.0:1789428183.860559:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789428183.860566:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940205056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789428183.860588:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789428183.860623:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940205056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428183.860636:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789428183.860674:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940205056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789428183.860690:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789428183.860697:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940205184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789428183.860733:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428183.860755:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940205184 00000100:00100000:1.0:1789428183.860758:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940205184 00000100:00100000:1.0:1789428183.860777:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789428183.860783:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940205184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789428183.860791:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789428183.860817:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940205184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428183.860823:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789428183.860849:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958444ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940205184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789428183.861937:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789428183.861951:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940205312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789428183.861991:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428183.862022:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940205312 00000100:00100000:1.0:1789428183.862028:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940205312 00000100:00100000:1.0:1789428183.862055:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428183.862062:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940205312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789428183.862075:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915857920 avail 3684335616 00000100:00100000:1.0:1789428183.862110:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940205312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428183.862117:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428183.862165:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940205312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789428184.153755:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428184.153857:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931714944 00000100:00100000:1.0:1789428184.153868:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931714944 00000100:00100000:1.0:1789428184.153916:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 111 00000100:00100000:1.0:1789428184.153924:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2393:x1876350931714944:12345-192.168.202.24@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789428184.153953:0:22711:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e26acd45-ce12-4c56-8027-8ae3c1aab989@192.168.202.24@tcp t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:1.0:1789428184.153983:0:22711:0:(genops.c:1384:class_connect()) connect: client e26acd45-ce12-4c56-8027-8ae3c1aab989, cookie 0x84fc867ede51a1cb 00000100:00080000:1.0:1789428184.154115:0:22711:0:(import.c:65:import_set_state_nolock()) ffff9196b8950000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789428184.154188:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+5:2393:x1876350931714944:12345-192.168.202.24@tcp:250:mount.lustre.0 Request processed in 262us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428184.154196:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 111 00000100:00100000:2.0:1789428184.159576:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428184.163725:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931715072 00000100:00100000:0.0:1789428184.163743:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931715072 00000100:00100000:0.0:1789428184.163828:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 112 00000100:00100000:0.0:1789428184.163841:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+5:18020:x1876350931715072:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789428184.163861:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428184.163885:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699964a00/0x84fc867ede51a1d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f73010bd expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428184.163937:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699964a00/0x84fc867ede51a1d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010bd expref: 6 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428184.163949:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699964a00/0x84fc867ede51a1d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010bd expref: 6 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428184.163958:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699964a00, rc 0) 00000100:00100000:0.0:1789428184.164036:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+6:18020:x1876350931715072:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 197us (4467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428184.164043:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 112 00000100:00100000:2.0:1789428184.166230:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428184.166540:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931715200 00000100:00100000:0.0:1789428184.166551:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931715200 00000100:00100000:0.0:1789428184.166606:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 113 00000100:00100000:0.0:1789428184.166616:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+6:18020:x1876350931715200:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789428184.166734:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+6:18020:x1876350931715200:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 119us (512us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789428184.166740:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 113 00000100:00100000:2.0:1789428184.173299:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428184.173473:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931715328 00000100:00100000:1.0:1789428184.173483:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931715328 00000100:00100000:1.0:1789428184.173530:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 114 00000100:00100000:1.0:1789428184.173540:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+6:18020:x1876350931715328:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789428184.173557:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428184.173574:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1f600/0x84fc867ede51a1d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f73010c4 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428184.173602:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1f600/0x84fc867ede51a1d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010c4 expref: 7 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428184.173612:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1f600/0x84fc867ede51a1d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010c4 expref: 7 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428184.173622:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1f600, rc 0) 00000100:00100000:1.0:1789428184.173681:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+7:18020:x1876350931715328:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 142us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428184.173700:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 114 00000100:00100000:2.0:1789428184.189472:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428184.189588:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931715456 00000100:00100000:1.0:1789428184.189598:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931715456 00000100:00100000:1.0:1789428184.189702:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 115 00000100:00100000:1.0:1789428184.189723:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+7:18020:x1876350931715456:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789428184.189921:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+8:18020:x1876350931715456:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 199us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428184.189930:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 115 00000100:00100000:2.0:1789428184.207081:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428184.208489:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931715584 00000100:00100000:1.0:1789428184.208504:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931715584 00000100:00100000:1.0:1789428184.208633:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00100000:1.0:1789428184.208644:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+8:18020:x1876350931715584:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789428184.208820:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+8:18020:x1876350931715584:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 178us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428184.208828:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 116 00000100:00100000:2.0:1789428184.214573:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428184.214686:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931715712 00000100:00100000:1.0:1789428184.214714:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931715712 00000100:00100000:1.0:1789428184.214793:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:1.0:1789428184.214806:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+8:18038:x1876350931715712:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789428184.215514:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+8:18038:x1876350931715712:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 709us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428184.215524:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 117 00000100:00100000:2.0:1789428184.277578:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428184.281176:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931715840 00000100:00100000:1.0:1789428184.281200:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931715840 00000100:00100000:1.0:1789428184.282072:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:1.0:1789428184.282089:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+8:18038:x1876350931715840:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789428184.283002:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+8:18038:x1876350931715840:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 910us (5431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428184.283015:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 118 00000100:00100000:1.0:1789428184.287768:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428184.288105:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931715968 00000100:00100000:0.0:1789428184.288121:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931715968 00000100:00100000:0.0:1789428184.288695:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:0.0:1789428184.288711:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+8:18038:x1876350931715968:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789428184.290156:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+8:18038:x1876350931715968:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 1433us (2386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428184.290172:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 119 00000100:00100000:0.0:1789428184.292959:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428184.293154:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931716096 00000100:00100000:1.0:1789428184.293173:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931716096 00000100:00100000:1.0:1789428184.293246:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:1.0:1789428184.293261:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+8:18020:x1876350931716096:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789428184.293282:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428184.293304:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583d1ec00/0x84fc867ede51a1e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f73010f5 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428184.293347:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583d1ec00/0x84fc867ede51a1e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010f5 expref: 9 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428184.293365:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583d1ec00/0x84fc867ede51a1e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010f5 expref: 9 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428184.293376:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583d1ec00, rc 0) 00000100:00100000:1.0:1789428184.293724:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+9:18020:x1876350931716096:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 468us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428184.293733:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 120 00000100:00100000:3.0:1789428184.301379:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428184.301621:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931716224 00000100:00100000:0.0:1789428184.301635:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931716224 00000100:00100000:0.0:1789428184.301708:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00100000:0.0:1789428184.301719:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+9:18020:x1876350931716224:12345-192.168.202.24@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789428184.301757:0:22709:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789428184.301795:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789428184.301799:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789428184.301803:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789428184.301806:0:22709:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789428184.301809:0:22709:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1789428184.304585:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+9:18020:x1876350931716224:12345-192.168.202.24@tcp:256:mount.lustre.0 Request processed in 2854us (3207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428184.304602:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 121 00000100:00100000:2.0:1789428184.308367:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428184.308695:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931716352 00000100:00100000:1.0:1789428184.308710:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931716352 00000100:00100000:1.0:1789428184.308787:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:1.0:1789428184.308799:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+9:18020:x1876350931716352:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789428184.308841:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428184.308870:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f46a00/0x84fc867ede51a1e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f73010fc expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428184.308913:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f46a00/0x84fc867ede51a1e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010fc expref: 10 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428184.308927:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f46a00/0x84fc867ede51a1e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010fc expref: 10 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428184.308938:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46a00, rc 0) 00000100:00100000:1.0:1789428184.309111:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+10:18020:x1876350931716352:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 312us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428184.309118:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 122 00000100:00100000:3.0:1789428184.311826:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428184.311954:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931716480 00000100:00100000:0.0:1789428184.311967:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931716480 00000100:00100000:0.0:1789428184.312084:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 123 00000100:00100000:0.0:1789428184.312096:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+10:18020:x1876350931716480:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789428184.312350:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+10:18020:x1876350931716480:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 255us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428184.312358:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 123 00000100:00100000:2.0:1789428184.314671:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428184.315005:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931716608 00000100:00100000:1.0:1789428184.315017:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931716608 00000100:00100000:1.0:1789428184.315078:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 124 00000100:00100000:1.0:1789428184.315090:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+10:18020:x1876350931716608:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789428184.315522:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+10:18020:x1876350931716608:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 432us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428184.315531:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 124 00000100:00100000:2.0:1789428184.318851:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428184.319272:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931716736 00000100:00100000:1.0:1789428184.319285:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931716736 00000100:00100000:1.0:1789428184.319367:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125 00000100:00100000:1.0:1789428184.319389:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+10:18045:x1876350931716736:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789428184.319631:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+10:18045:x1876350931716736:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 253us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428184.319648:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125 00000100:00100000:2.0:1789428184.334092:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428184.334200:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931716864 00000100:00100000:3.0:1789428184.334215:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931716864 00000100:00100000:3.0:1789428184.334299:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 126 00000100:00100000:3.0:1789428184.334311:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+10:18045:x1876350931716864:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789428184.334598:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+10:18045:x1876350931716864:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 288us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428184.334607:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 126 00000100:00100000:2.0:1789428184.339553:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428184.339876:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931716992 00000100:00100000:0.0:1789428184.339890:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931716992 00000100:00100000:0.0:1789428184.339958:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:0.0:1789428184.339969:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2393:x1876350931716992:12345-192.168.202.24@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789428184.340009:0:22718:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 0304e1d9-31ca-4d6f-ad12-f6b219f360cb@192.168.202.24@tcp t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:0.0:1789428184.340078:0:22718:0:(genops.c:1384:class_connect()) connect: client 0304e1d9-31ca-4d6f-ad12-f6b219f360cb, cookie 0x84fc867ede51a1ee 00000004:00100000:0.0:1789428184.340113:0:22718:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789428184.340466:0:22718:0:(import.c:65:import_set_state_nolock()) ffff919581793800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789428184.340552:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:2393:x1876350931716992:12345-192.168.202.24@tcp:38:mount.lustre.0 Request processed in 582us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428184.340560:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:2.0:1789428184.340849:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428184.340962:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931717248 00000100:00100000:0.0:1789428184.340969:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931717248 00000100:00100000:0.0:1789428184.341005:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:0.0:1789428184.341013:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2393:x1876350931717248:12345-192.168.202.24@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789428184.341037:0:22716:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 0304e1d9-31ca-4d6f-ad12-f6b219f360cb@192.168.202.24@tcp t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:0.0:1789428184.341081:0:22716:0:(genops.c:1384:class_connect()) connect: client 0304e1d9-31ca-4d6f-ad12-f6b219f360cb, cookie 0x84fc867ede51a1f5 00000004:00100000:0.0:1789428184.341099:0:22716:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789428184.346804:0:22716:0:(import.c:65:import_set_state_nolock()) ffff919581792000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789428184.346926:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:2393:x1876350931717248:12345-192.168.202.24@tcp:38:mount.lustre.0 Request processed in 5904us (6069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428184.346942:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:2.0:1789428184.356023:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428184.356067:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428184.356097:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428184.356189:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931717504 00000100:00100000:3.0:1789428184.356202:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931717504 00000100:00100000:3.0:1789428184.356291:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931717376 00000100:00100000:3.0:1789428184.356295:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931717376 00000100:00100000:3.0:1789428184.356309:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931717120 00000100:00100000:3.0:1789428184.356311:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931717120 00000100:00100000:3.0:1789428184.356337:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:3.0:1789428184.356350:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:18020:x1876350931717504:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789428184.356449:0:22717:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789428184.356562:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:18020:x1876350931717504:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 215us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428184.356570:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:3.0:1789428184.356611:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:3.0:1789428184.356617:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:0:x1876350931717376:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789428184.356637:0:22717:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789428184.356676:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:0:x1876350931717376:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 59us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428184.356682:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:3.0:1789428184.356696:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:3.0:1789428184.356702:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:0:x1876350931717120:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789428184.356712:0:22717:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789428184.356733:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:0:x1876350931717120:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 31us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428184.356739:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00080000:2.0:1789428184.356928:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789428184.356934:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789428184.364571:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428184.365027:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931717632 00000100:00100000:1.0:1789428184.365041:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931717632 00000100:00100000:1.0:1789428184.365123:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:1.0:1789428184.365136:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:18020:x1876350931717632:12345-192.168.202.24@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789428184.365268:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:18020:x1876350931717632:12345-192.168.202.24@tcp:40:mount.lustre.0 Request processed in 134us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428184.365275:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:2.0:1789428184.368690:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428184.368738:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428184.368763:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428184.368884:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931717760 00000100:00100000:0.0:1789428184.368897:0:25188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931717760 00000100:00100000:0.0:1789428184.368945:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931717888 00000100:00100000:0.0:1789428184.368949:0:25188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931717888 00000100:00100000:0.0:1789428184.368971:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:0.0:1789428184.368982:0:25188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2393:x1876350931717760:12345-192.168.202.24@tcp:8:mount.lustre.0 00000100:00100000:1.0:1789428184.368999:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931718016 00000100:00100000:1.0:1789428184.369004:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931718016 00010000:00080000:0.0:1789428184.369026:0:25188:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 0304e1d9-31ca-4d6f-ad12-f6b219f360cb@192.168.202.24@tcp t0 exp 0000000000000000 cur 528 last 0 00000100:00100000:1.0:1789428184.369043:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:1.0:1789428184.369050:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:18020:x1876350931718016:12345-192.168.202.24@tcp:900:mount.lustre.0 00000020:00000080:0.0:1789428184.369066:0:25188:0:(genops.c:1384:class_connect()) connect: client 0304e1d9-31ca-4d6f-ad12-f6b219f360cb, cookie 0x84fc867ede51a1fc 00002000:00100000:0.0:1789428184.369081:0:25188:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0304e1d9-31ca-4d6f-ad12-f6b219f360cb/ffff919581791000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789428184.369094:0:25188:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789428184.369138:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:18020:x1876350931718016:12345-192.168.202.24@tcp:900:mount.lustre.0 Request processed in 89us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428184.369146:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:1.0:1789428184.369202:0:25192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:1.0:1789428184.369208:0:25192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2393:x1876350931717888:12345-192.168.202.24@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789428184.369225:0:25192:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 0304e1d9-31ca-4d6f-ad12-f6b219f360cb@192.168.202.24@tcp t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:1.0:1789428184.369246:0:25192:0:(genops.c:1384:class_connect()) connect: client 0304e1d9-31ca-4d6f-ad12-f6b219f360cb, cookie 0x84fc867ede51a203 00002000:00100000:1.0:1789428184.369264:0:25192:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0304e1d9-31ca-4d6f-ad12-f6b219f360cb/ffff9196b8954800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789428184.369272:0:25192:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789428184.369386:0:25188:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789428184.369455:0:25188:0:(import.c:65:import_set_state_nolock()) ffff919581796000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789428184.369492:0:25188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:2393:x1876350931717760:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 511us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428184.369500:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00002000:00080000:1.0:1789428184.371669:0:25192:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789428184.371728:0:25192:0:(import.c:65:import_set_state_nolock()) ffff9196b8955800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789428184.371830:0:25192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:2393:x1876350931717888:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 2619us (3063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428184.371842:0:25192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:1.0:1789428184.372943:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940205440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789428184.373024:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428184.373155:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940205440 00000100:00100000:0.0:1789428184.373165:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940205440 00000100:00100000:0.0:1789428184.373228:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789428184.373241:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958444fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940205440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789428184.373275:0:23457:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789428184.373344:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958444fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940205440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428184.373352:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789428184.373787:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940205440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789428184.375521:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000001:00100000:3.0:1789428184.376171:0:25035:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0304e1d9-31ca-4d6f-ad12-f6b219f360cb 00000001:00080000:3.0:1789428184.376188:0:25035:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:1.0:1789428184.376443:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931718144 00000100:00100000:1.0:1789428184.376455:0:22719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931718144 00000100:00100000:1.0:1789428184.376565:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:1.0:1789428184.376577:0:22719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:18020:x1876350931718144:12345-192.168.202.24@tcp:33:mount.lustre.0 00000004:00080000:1.0:1789428184.381236:0:22719:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4550us 00000004:00200000:0.0:1789428184.397045:0:22719:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789428184.397177:0:22719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:18020:x1876350931718144:12345-192.168.202.24@tcp:33:mount.lustre.0 Request processed in 20597us (21662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428184.397192:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00010000:00010000:0.0:1789428184.498640:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428184.553306:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428184.553555:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931718272 00000100:00100000:0.0:1789428184.553569:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931718272 00000100:00100000:0.0:1789428184.553651:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:0.0:1789428184.553662:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:18068:x1876350931718272:12345-192.168.202.24@tcp:101:mkdir.0 00010000:00010000:0.0:1789428184.553690:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428184.553724:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a20a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730112d expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428184.553818:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a211 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428184.553853:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428184.553869:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428184.553934:0:22716:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789428184.553939:0:22716:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789428184.553987:0:22716:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a211 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428184.554022:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a20a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730112d expref: 8 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428184.554047:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a211 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730112d expref: 7 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428184.554055:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f900) 00010000:00010000:0.0:1789428184.554059:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789428184.554063:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965a00, rc 0) 00000100:00100000:0.0:1789428184.554167:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:18068:x1876350931718272:12345-192.168.202.24@tcp:101:mkdir.0 Request processed in 506us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428184.554176:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:0.0:1789428184.880878:0:3613:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789428184.885444:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940205568:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789428184.885581:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428184.886143:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940205568 00000100:00100000:3.0:1789428184.886156:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940205568 00000100:00100000:3.0:1789428184.886232:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789428184.886243:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940205568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789428184.886296:0:22721:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789428184.886493:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940205568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 251us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428184.886501:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789428184.886945:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940205568:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1789428185.521634:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789428185.522445:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789428185.969232:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789428186.401909:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428186.402223:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931718400 00000100:00100000:0.0:1789428186.402238:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931718400 00000100:00100000:0.0:1789428186.402356:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:0.0:1789428186.402369:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:18120:x1876350931718400:12345-192.168.202.24@tcp:41:lfs.0 00000004:00000024:0.0:1789428186.402492:0:24790:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789428186.402623:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:18120:x1876350931718400:12345-192.168.202.24@tcp:41:lfs.0 Request processed in 256us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428186.402632:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00080000:2.0:1789428186.403025:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789428186.408233:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428186.408731:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931718528 00000100:00100000:0.0:1789428186.408745:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931718528 00000100:00100000:0.0:1789428186.408873:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00100000:0.0:1789428186.408888:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:18120:x1876350931718528:12345-192.168.202.24@tcp:41:lfs.0 00000004:00000024:0.0:1789428186.408944:0:22716:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789428186.409070:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:18120:x1876350931718528:12345-192.168.202.24@tcp:41:lfs.0 Request processed in 186us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428186.409077:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00080000:2.0:1789428186.409887:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789428186.414508:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428186.414767:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931718656 00000100:00100000:1.0:1789428186.414780:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931718656 00000100:00100000:1.0:1789428186.414866:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:1.0:1789428186.414878:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:18120:x1876350931718656:12345-192.168.202.24@tcp:13:lfs.0 00002000:00000024:1.0:1789428186.414920:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1789428186.415037:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:18120:x1876350931718656:12345-192.168.202.24@tcp:13:lfs.0 Request processed in 160us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428186.415044:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00080000:2.0:1789428186.415337:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789428186.418847:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428186.419118:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931718784 00000100:00100000:2.0:1789428186.419132:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931718784 00000100:00080000:0.0:1789428186.419296:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789428186.419492:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:2.0:1789428186.419505:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:18120:x1876350931718784:12345-192.168.202.24@tcp:13:lfs.0 00002000:00000024:2.0:1789428186.419547:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789428186.419668:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:18120:x1876350931718784:12345-192.168.202.24@tcp:13:lfs.0 Request processed in 166us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428186.419675:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00010000:00010000:3.0:1789428186.544821:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428186.555615:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428186.556356:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931718912 00000100:00100000:1.0:1789428186.556374:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931718912 00000100:00100000:1.0:1789428186.556504:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 127 00000100:00100000:1.0:1789428186.556517:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196a8fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+10:18152:x1876350931718912:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789428186.556542:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428186.556595:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f47c00/0x84fc867ede51a218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7301134 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428186.556639:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f47c00/0x84fc867ede51a218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301134 expref: 11 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428186.556654:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f47c00/0x84fc867ede51a218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301134 expref: 11 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428186.556667:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47c00, rc 0) 00000100:00100000:1.0:1789428186.556776:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196a8fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:18152:x1876350931718912:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 260us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428186.556783:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 127 00000100:00100000:0.0:1789428186.563282:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428186.564760:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931719040 00000100:00100000:1.0:1789428186.564779:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931719040 00000100:00100000:1.0:1789428186.564881:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00100000:1.0:1789428186.564900:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968290ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:18152:x1876350931719040:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789428186.565134:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968290ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:18152:x1876350931719040:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 236us (1868us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428186.565143:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 128 00000100:00100000:2.0:1789428186.579829:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428186.580145:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931719168 00000100:00100000:3.0:1789428186.580161:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931719168 00000100:00100000:3.0:1789428186.580241:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 129 00000100:00100000:3.0:1789428186.580253:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968290e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:18152:x1876350931719168:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789428186.580526:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968290e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:18152:x1876350931719168:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 274us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428186.580534:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 129 00000100:00100000:2.0:1789428186.593179:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428186.593587:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931719296 00000100:00100000:0.0:1789428186.593601:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931719296 00000100:00100000:0.0:1789428186.593675:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 130 00000100:00100000:0.0:1789428186.593687:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:18159:x1876350931719296:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789428186.594005:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae885c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:18159:x1876350931719296:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 319us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428186.594014:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 130 00000100:00100000:0.0:1789428186.619881:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428186.620049:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931719424 00000100:00100000:3.0:1789428186.620064:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931719424 00000100:00100000:3.0:1789428186.620141:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 131 00000100:00100000:3.0:1789428186.620156:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:18159:x1876350931719424:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789428186.620468:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae887c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:18159:x1876350931719424:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 313us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428186.620477:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 131 00000100:00100000:2.0:1789428186.632845:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428186.633314:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931719552 00000100:00100000:0.0:1789428186.633331:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931719552 00000100:00100000:0.0:1789428186.633470:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 132 00000100:00100000:0.0:1789428186.633484:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:18159:x1876350931719552:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789428186.633734:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae885850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:18159:x1876350931719552:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 253us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428186.633743:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 132 00000100:00100000:2.0:1789428186.637015:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428186.637117:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931719680 00000100:00100000:1.0:1789428186.637132:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931719680 00000100:00100000:1.0:1789428186.637326:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 133 00000100:00100000:1.0:1789428186.637339:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:18152:x1876350931719680:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789428186.637530:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428186.637562:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f46200/0x84fc867ede51a21f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f7301165 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428186.637626:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f46200/0x84fc867ede51a21f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301165 expref: 12 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428186.637641:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f46200/0x84fc867ede51a21f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301165 expref: 12 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428186.637652:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46200, rc 0) 00000100:00100000:1.0:1789428186.637826:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae885450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+12:18152:x1876350931719680:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 488us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428186.637834:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 133 00000100:00100000:1.0:1789428186.642807:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428186.642873:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931719808 00000100:00100000:3.0:1789428186.642887:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931719808 00000100:00100000:3.0:1789428186.642968:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 134 00000100:00100000:3.0:1789428186.642981:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+12:18152:x1876350931719808:12345-192.168.202.24@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789428186.643020:0:22711:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789428186.643061:0:22711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789428186.643065:0:22711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789428186.643069:0:22711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789428186.643072:0:22711:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789428186.643076:0:22711:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:3.0:1789428186.648612:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae887450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+12:18152:x1876350931719808:12345-192.168.202.24@tcp:256:mount.lustre.0 Request processed in 5616us (5800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428186.648651:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 134 00000100:00100000:2.0:1789428186.651562:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428186.651673:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931719936 00000100:00100000:1.0:1789428186.651686:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931719936 00000100:00100000:1.0:1789428186.651742:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 135 00000100:00100000:1.0:1789428186.651751:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+12:18152:x1876350931719936:12345-192.168.202.24@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789428186.651773:0:22710:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428186.651793:0:22710:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f47800/0x84fc867ede51a226 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f730116c expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428186.651824:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f47800/0x84fc867ede51a226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730116c expref: 13 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428186.651834:0:22710:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f47800/0x84fc867ede51a226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730116c expref: 13 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428186.651841:0:22710:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47800, rc 0) 00000100:00100000:1.0:1789428186.651895:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae886050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18152:x1876350931719936:12345-192.168.202.24@tcp:101:mount.lustre.0 Request processed in 146us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428186.651916:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 135 00000100:00100000:1.0:1789428186.653501:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428186.653555:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931720064 00000100:00100000:3.0:1789428186.653567:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931720064 00000100:00100000:3.0:1789428186.653627:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 136 00000100:00100000:3.0:1789428186.653638:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18152:x1876350931720064:12345-192.168.202.24@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789428186.653813:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae886850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18152:x1876350931720064:12345-192.168.202.24@tcp:501:mount.lustre.0 Request processed in 177us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428186.653821:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 136 00000100:00100000:2.0:1789428186.655084:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428186.655219:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931720192 00000100:00100000:0.0:1789428186.655277:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931720192 00000100:00100000:0.0:1789428186.655343:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 137 00000100:00100000:0.0:1789428186.655354:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18152:x1876350931720192:12345-192.168.202.24@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789428186.655672:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae884850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18152:x1876350931720192:12345-192.168.202.24@tcp:503:mount.lustre.0 Request processed in 320us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428186.655681:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 137 00000100:00100000:2.0:1789428186.658882:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428186.658959:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931720320 00000100:00100000:1.0:1789428186.658973:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931720320 00000100:00100000:1.0:1789428186.659046:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00100000:1.0:1789428186.659059:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18163:x1876350931720320:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789428186.659491:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae887850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18163:x1876350931720320:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 434us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428186.659498:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 138 00000100:00100000:1.0:1789428186.661989:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428186.662070:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931720448 00000100:00100000:0.0:1789428186.662081:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931720448 00000100:00100000:0.0:1789428186.662175:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 139 00000100:00100000:0.0:1789428186.662187:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18163:x1876350931720448:12345-192.168.202.24@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789428186.662442:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae887050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18163:x1876350931720448:12345-192.168.202.24@tcp:502:llog_process_th.0 Request processed in 230us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428186.662450:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 139 00000100:00100000:2.0:1789428186.668567:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428186.668678:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428186.669105:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931720576 00000100:00100000:1.0:1789428186.669120:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931720576 00000100:00100000:1.0:1789428186.669180:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931720832 00000100:00100000:1.0:1789428186.669184:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931720832 00000100:00100000:1.0:1789428186.669214:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:1.0:1789428186.669225:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1876350931720576:12345-192.168.202.24@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789428186.669271:0:22717:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 6def47a4-6189-4bdd-97b7-d460dc95e7fc@192.168.202.24@tcp t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:1.0:1789428186.669370:0:22717:0:(genops.c:1384:class_connect()) connect: client 6def47a4-6189-4bdd-97b7-d460dc95e7fc, cookie 0x84fc867ede51a22d 00000004:00100000:1.0:1789428186.669406:0:22717:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789428186.669731:0:22717:0:(import.c:65:import_set_state_nolock()) ffff9196ad427000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789428186.669823:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:2393:x1876350931720576:12345-192.168.202.24@tcp:38:mount.lustre.0 Request processed in 598us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428186.669832:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:1.0:1789428186.669860:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:1.0:1789428186.669865:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2393:x1876350931720832:12345-192.168.202.24@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789428186.669894:0:22717:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 6def47a4-6189-4bdd-97b7-d460dc95e7fc@192.168.202.24@tcp t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:1.0:1789428186.669933:0:22717:0:(genops.c:1384:class_connect()) connect: client 6def47a4-6189-4bdd-97b7-d460dc95e7fc, cookie 0x84fc867ede51a234 00000004:00100000:1.0:1789428186.669950:0:22717:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789428186.670004:0:22717:0:(import.c:65:import_set_state_nolock()) ffff9196ad423800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789428186.670030:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:2393:x1876350931720832:12345-192.168.202.24@tcp:38:mount.lustre.0 Request processed in 164us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428186.670038:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:2.0:1789428186.676231:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428186.676322:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428186.676482:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931721088 00000100:00100000:3.0:1789428186.676495:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931721088 00000100:00100000:1.0:1789428186.676624:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931720704 00000100:00100000:1.0:1789428186.676629:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931720704 00000100:00100000:1.0:1789428186.676710:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:1.0:1789428186.676722:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+7:0:x1876350931720704:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789428186.676774:0:22717:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789428186.676865:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+7:0:x1876350931720704:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 146us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428186.676873:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:3.0:1789428186.677980:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:3.0:1789428186.677995:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:18152:x1876350931721088:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789428186.678023:0:22718:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789428186.678086:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:18152:x1876350931721088:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 95us (1882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428186.678094:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:2.0:1789428186.680989:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428186.681098:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931720960 00000100:00100000:1.0:1789428186.681111:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931720960 00000100:00080000:0.0:1789428186.681189:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789428186.681195:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789428186.681831:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428186.682145:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931721216 00000100:00100000:0.0:1789428186.682153:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931721216 00000100:00100000:0.0:1789428186.682519:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:0.0:1789428186.682533:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:18152:x1876350931721216:12345-192.168.202.24@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789428186.682827:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:18152:x1876350931721216:12345-192.168.202.24@tcp:40:mount.lustre.0 Request processed in 297us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428186.682836:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:1.0:1789428186.683764:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:1.0:1789428186.683779:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:0:x1876350931720960:12345-192.168.202.24@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789428186.683819:0:22717:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789428186.683899:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:0:x1876350931720960:12345-192.168.202.24@tcp:41:mount.lustre.0 Request processed in 122us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428186.683906:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:2.0:1789428186.690960:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428186.691013:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428186.691057:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428186.691166:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931721600 00000100:00100000:1.0:1789428186.691179:0:22728:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931721600 00000100:00100000:1.0:1789428186.691288:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:1.0:1789428186.691311:0:22728:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:18152:x1876350931721600:12345-192.168.202.24@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789428186.691472:0:22728:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:18152:x1876350931721600:12345-192.168.202.24@tcp:900:mount.lustre.0 Request processed in 173us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428186.691480:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:3.0:1789428186.691733:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931721344 00000100:00100000:3.0:1789428186.691739:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931721344 00000100:00100000:3.0:1789428186.691777:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931721472 00000100:00100000:3.0:1789428186.691780:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931721472 00000100:00100000:3.0:1789428186.691805:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:3.0:1789428186.691812:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1876350931721344:12345-192.168.202.24@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789428186.691848:0:24220:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6def47a4-6189-4bdd-97b7-d460dc95e7fc@192.168.202.24@tcp t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:3.0:1789428186.691891:0:24220:0:(genops.c:1384:class_connect()) connect: client 6def47a4-6189-4bdd-97b7-d460dc95e7fc, cookie 0x84fc867ede51a23b 00002000:00100000:3.0:1789428186.691907:0:24220:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6def47a4-6189-4bdd-97b7-d460dc95e7fc/ffff9196bc9e5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789428186.691933:0:24220:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789428186.692023:0:24220:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789428186.692061:0:24220:0:(import.c:65:import_set_state_nolock()) ffff9196bc9e6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428186.692108:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:2393:x1876350931721344:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 295us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428186.692115:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:3.0:1789428186.692132:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:3.0:1789428186.692137:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2393:x1876350931721472:12345-192.168.202.24@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789428186.692155:0:24220:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6def47a4-6189-4bdd-97b7-d460dc95e7fc@192.168.202.24@tcp t0 exp 0000000000000000 cur 531 last 0 00000020:00000080:3.0:1789428186.692173:0:24220:0:(genops.c:1384:class_connect()) connect: client 6def47a4-6189-4bdd-97b7-d460dc95e7fc, cookie 0x84fc867ede51a242 00002000:00100000:3.0:1789428186.692179:0:24220:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6def47a4-6189-4bdd-97b7-d460dc95e7fc/ffff9196bc9e7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a29 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789428186.692186:0:24220:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789428186.692239:0:24220:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789428186.692257:0:24220:0:(import.c:65:import_set_state_nolock()) ffff9196be384800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789428186.692282:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:2393:x1876350931721472:12345-192.168.202.24@tcp:8:mount.lustre.0 Request processed in 143us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428186.692288:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:2.0:1789428186.698647:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428186.698859:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931721728 00000100:00100000:0.0:1789428186.698876:0:22720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931721728 00000100:00100000:0.0:1789428186.699110:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:0.0:1789428186.699122:0:22720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:18152:x1876350931721728:12345-192.168.202.24@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789428186.699560:0:22720:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789428186.699854:0:22720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:18152:x1876350931721728:12345-192.168.202.24@tcp:33:mount.lustre.0 Request processed in 734us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428186.699862:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:3.0:1789428186.849841:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428186.850351:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931721856 00000100:00100000:2.0:1789428186.850376:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931721856 00000100:00100000:2.0:1789428186.850491:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:2.0:1789428186.850505:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:18186:x1876350931721856:12345-192.168.202.24@tcp:101:mkdir.0 00010000:00010000:2.0:1789428186.850565:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428186.850598:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a249 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730119d expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428186.850703:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ece00/0x84fc867ede51a250 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428186.850718:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ece00/0x84fc867ede51a250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428186.850729:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ece00/0x84fc867ede51a250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428186.850784:0:22718:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789428186.850787:0:22718:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789428186.850809:0:22718:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ece00/0x84fc867ede51a250 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428186.850835:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a249 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730119d expref: 8 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428186.850853:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ece00/0x84fc867ede51a250 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730119d expref: 7 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428186.850860:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f900) 00010000:00010000:2.0:1789428186.850862:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789428186.850866:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ece00, rc 0) 00000100:00100000:2.0:1789428186.850938:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfa83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6def47a4-6189-4bdd-97b7-d460dc95e7fc+7:18186:x1876350931721856:12345-192.168.202.24@tcp:101:mkdir.0 Request processed in 438us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428186.850944:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00010000:00010000:0.0:1789428187.569108:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428187.953876:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940205696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789428187.953953:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428187.954114:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940205696 00000100:00100000:1.0:1789428187.954123:0:24225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940205696 00000100:00100000:1.0:1789428187.954193:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789428187.954197:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789428187.954205:0:24225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940205696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789428187.954235:0:24225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1789428187.954387:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940205696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789428187.954395:0:24225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940205696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428187.954404:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1789428188.595215:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428188.976826:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940206080:0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.976936:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428188.977006:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940206592:0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977032:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428188.977054:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940207104:0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977081:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428188.977125:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789428188.977131:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940205952:0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977158:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428188.977179:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940206464:0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977197:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428188.977223:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940206976:0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977243:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428188.977273:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940206080 00000100:00100000:3.0:1789428188.977294:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940206080 00000100:00100000:3.0:1789428188.977346:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940206592 00000100:00100000:3.0:1789428188.977349:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940206592 00000100:00100000:3.0:1789428188.977385:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789428188.977396:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940206080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977481:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688822300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940206080:12345-0@lo:400:kworker.0 Request processed in 87us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428188.977488:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789428188.977510:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789428188.977516:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940206592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977543:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688822a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940206592:12345-0@lo:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428188.977550:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789428188.977571:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940205952 00000100:00100000:3.0:1789428188.977575:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940205952 00000100:00100000:3.0:1789428188.977603:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940206464 00000100:00100000:3.0:1789428188.977605:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940206464 00000100:00100000:3.0:1789428188.977620:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789428188.977626:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940205952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977673:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688820e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940205952:12345-0@lo:400:kworker.0 Request processed in 47us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428188.977681:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789428188.977693:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789428188.977699:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940206464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977726:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940206464:12345-0@lo:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428188.977731:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789428188.977748:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789428188.977787:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688823b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940205952:0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977796:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688823800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940206464:0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977804:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940206080:0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977812:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688823480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940206592:0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977868:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940207104 00000100:00100000:3.0:1789428188.977871:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940207104 00000100:00100000:3.0:1789428188.977902:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940206976 00000100:00100000:3.0:1789428188.977905:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940206976 00000100:00100000:3.0:1789428188.977921:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789428188.977927:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940207104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.977956:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940207104:12345-0@lo:400:kworker.0 Request processed in 30us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428188.977962:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789428188.977971:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789428188.977975:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940206976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.978009:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688820a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1876350940206976:12345-0@lo:400:kworker.0 Request processed in 33us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428188.978015:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1789428188.978027:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789428188.978029:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789428188.978043:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688821f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3614:1876350940206976:0@lo:400:kworker.0 00010000:00080000:3.0:1789428188.978056:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919688822d80 x1876350940207104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789428188.978067:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688822d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940207104:0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.978160:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e871a47a-d8aa-4c92-86ef-047b0047c703:3616:1876350940205824:0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.978203:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428188.978240:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940206336:0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.978262:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428188.978277:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940206848:0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.978309:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428188.978323:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940207360:0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.978344:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428188.978365:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789428188.978371:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940206208:0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.978393:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428188.978410:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940206720:0@lo:400:kworker.0 00000100:00100000:1.0:1789428188.978457:0:25192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940206208 00000100:00100000:0.0:1789428188.978465:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428188.978466:0:25192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940206208 00000100:00100000:0.0:1789428188.978485:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940207232:0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.978505:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428188.978524:0:25192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940206720 00000100:00100000:1.0:1789428188.978529:0:25192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940206720 00000100:00100000:0.0:1789428188.978533:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940206336 00000100:00100000:0.0:1789428188.978539:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940206336 00000100:00100000:1.0:1789428188.978553:0:25192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428188.978563:0:25192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940206208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.978567:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940206848 00000100:00100000:0.0:1789428188.978571:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940206848 00000100:00100000:0.0:1789428188.978589:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940207360 00000100:00100000:0.0:1789428188.978592:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940207360 00000100:00100000:0.0:1789428188.978608:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940207232 00000100:00100000:0.0:1789428188.978611:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940207232 00000100:00100000:1.0:1789428188.978623:0:25192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940206208:12345-0@lo:400:kworker.0 Request processed in 62us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428188.978631:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789428188.978635:0:25192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789428188.978642:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940206336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428188.978658:0:25192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428188.978667:0:25192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940206720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.978683:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1876350940206336:12345-0@lo:400:kworker.0 Request processed in 42us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428188.978691:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789428188.978710:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789428188.978719:0:25192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940206720:12345-0@lo:400:kworker.0 Request processed in 53us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428188.978721:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940206848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428188.978735:0:25192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789428188.978764:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1876350940206848:12345-0@lo:400:kworker.0 Request processed in 44us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428188.978767:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789428188.978777:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789428188.978782:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940207360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.978797:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789428188.978806:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940207232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428188.978821:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1876350940207360:12345-0@lo:400:kworker.0 Request processed in 42us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428188.978828:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789428188.978852:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1876350940207232:12345-0@lo:400:kworker.0 Request processed in 47us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428188.978860:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1789428188.978960:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789428188.978965:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789428188.978967:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789428188.978985:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1789428188.979002:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688821180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940206208:0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.979013:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688823100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940206720:0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.979023:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688822680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3616:1876350940207232:0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.979033:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3616:1876350940206336:0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.979043:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3616:1876350940206848:0@lo:400:kworker.0 00010000:00080000:0.0:1789428188.979054:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff919688821880 x1876350940207360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428188.979063:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688821880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3616:1876350940207360:0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.979076:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789428188.979083:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940207744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789428188.979109:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428188.979203:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940205824 00000100:00100000:3.0:1789428188.979209:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940205824 00000100:00100000:3.0:1789428188.979241:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789428188.979248:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+24:3616:x1876350940205824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428188.979297:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae884050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+24:3616:x1876350940205824:12345-0@lo:400:kworker.0 Request processed in 50us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428188.979303:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789428188.979360:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940207744 00000100:00100000:3.0:1789428188.979363:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940207744 00000100:00100000:1.0:1789428188.982968:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940207616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789428188.982968:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940207488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789428188.983076:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428188.983435:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e871a47a-d8aa-4c92-86ef-047b0047c703:3616:1876350940205824:0@lo:400:kworker.0 00000100:00100000:0.0:1789428188.986512:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428188.986975:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940207488 00000100:00100000:3.0:1789428188.986990:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940207488 00000100:00100000:3.0:1789428188.987062:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789428188.987078:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940207744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789428188.987131:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789428188.987470:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1876350940207744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 397us (8358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428188.987480:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789428188.987514:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789428188.987522:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940207488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789428188.987537:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1789428188.987582:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940207488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (4507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428188.987589:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789428188.987680:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3616:1876350940207744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789428188.988019:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940207488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789428188.988076:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940207616 00000100:00100000:3.0:1789428188.988082:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940207616 00000100:00100000:3.0:1789428188.988143:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789428188.988151:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940207616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789428188.988184:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1789428188.988350:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940207616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 200us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428188.988357:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789428188.988451:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940207616:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1789428189.471685:0:25592:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789428189.489776:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789428189.494521:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940207872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789428189.494627:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428189.494975:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940207872 00000100:00100000:2.0:1789428189.494988:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940207872 00000100:00100000:3.0:1789428189.495171:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789428189.495184:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940207872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789428189.495236:0:22721:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789428189.495323:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688822d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940207872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428189.495341:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789428189.495471:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940207872:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789428189.618891:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428190.006040:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940208000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789428190.006145:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428190.007262:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940208000 00000100:00100000:1.0:1789428190.007341:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940208000 00000100:00100000:1.0:1789428190.007449:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789428190.007462:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940208000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789428190.007515:0:22722:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789428190.007631:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1876350940208000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 171us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428190.007639:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789428190.007937:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3613:1876350940208000:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1789428190.522374:0:23449:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6def47a4-6189-4bdd-97b7-d460dc95e7fc 00000001:00100000:3.0:1789428190.522394:0:23449:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0304e1d9-31ca-4d6f-ad12-f6b219f360cb 00000001:00100000:0.0:1789428190.524643:0:22696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6def47a4-6189-4bdd-97b7-d460dc95e7fc 00000001:00100000:0.0:1789428190.524657:0:22696:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0304e1d9-31ca-4d6f-ad12-f6b219f360cb 00000001:00100000:3.0:1789428190.527942:0:24217:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6def47a4-6189-4bdd-97b7-d460dc95e7fc 00000001:00100000:3.0:1789428190.527962:0:24217:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0304e1d9-31ca-4d6f-ad12-f6b219f360cb 00010000:00010000:0.0:1789428190.641013:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428191.668805:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428191.729262:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428191.729301:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428191.729340:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428191.729369:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428191.729396:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428191.729447:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428191.729469:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931722240 00000100:00100000:0.0:1789428191.729473:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428191.729483:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931722240 00000100:00100000:0.0:1789428191.729495:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428191.729524:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428191.729550:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931722752 00000100:00100000:0.0:1789428191.729553:0:25192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931722496 00000100:00100000:2.0:1789428191.729555:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931722752 00000100:00100000:0.0:1789428191.729559:0:25192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931722496 00000100:00100000:2.0:1789428191.729578:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931722112 00000100:00100000:2.0:1789428191.729582:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931722112 00000100:00100000:0.0:1789428191.729600:0:25192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931723008 00000100:00100000:2.0:1789428191.729605:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931722624 00000100:00100000:0.0:1789428191.729606:0:25192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931723008 00000100:00100000:2.0:1789428191.729611:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931722624 00000100:00100000:0.0:1789428191.729628:0:25192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931722368 00000100:00100000:0.0:1789428191.729632:0:25192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931722368 00000100:00100000:0.0:1789428191.729655:0:25192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931722880 00000100:00100000:0.0:1789428191.729659:0:25192:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931722880 00000100:00100000:2.0:1789428191.729660:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:2.0:1789428191.729675:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2394:x1876350931722240:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789428191.729677:0:25192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:0.0:1789428191.729691:0:25192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2394:x1876350931722496:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789428191.729751:0:25192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2394:x1876350931722496:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 64us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428191.729780:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:0.0:1789428191.729780:0:25192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:3.0:1789428191.729795:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+5:2394:x1876350931722752:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789428191.729804:0:25192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 12 00000100:00100000:0.0:1789428191.729813:0:25192:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:2394:x1876350931723008:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789428191.729871:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931721984 00000100:00100000:1.0:1789428191.729875:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931721984 00000100:00100000:1.0:1789428191.729905:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 141 00000100:00100000:1.0:1789428191.729912:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ae884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:2394:x1876350931721984:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428191.731689:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2394:x1876350931722240:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 2010us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428191.731703:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:2.0:1789428191.731743:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:2.0:1789428191.731755:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:2394:x1876350931722112:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428191.731792:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:2394:x1876350931722112:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 42us (2346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428191.731799:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:2.0:1789428191.731815:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:2.0:1789428191.731825:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:2394:x1876350931722624:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428191.731852:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:2394:x1876350931722624:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 32us (2358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428191.731861:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00080000:2.0:1789428191.734486:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789428191.734497:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789428191.734500:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789428191.734503:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789428191.734536:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:2.0:1789428191.734560:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2394:x1876350931722368:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428191.734635:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2394:x1876350931722368:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 88us (5162us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428191.734643:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:2.0:1789428191.734667:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:2.0:1789428191.734673:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfb8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+5:2394:x1876350931722880:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428191.734697:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfb8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+5:2394:x1876350931722880:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 24us (5172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428191.734703:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:2.0:1789428191.742953:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+5:2394:x1876350931722752:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 13151us (13571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428191.742969:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:1.0:1789428191.742982:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ae884450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:2394:x1876350931721984:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 13066us (13737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428191.742994:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 141 00000100:00100000:0.0:1789428191.743113:0:25192:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:2394:x1876350931723008:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 13299us (13713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428191.743123:0:25192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 12 00000020:00000080:2.0:1789428192.514703:0:25739:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5620f3c0 20000000:00000080:2.0:1789428192.514726:0:25739:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9196b6b5a800 uarg=0000000000000000 20000000:01000000:2.0:1789428192.514779:0:25739:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789428192.514785:0:25739:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789428192.514791:0:25739:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789428192.516361:0:25740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1789428192.517859:0:25739:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789428192.530546:0:25739:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789428192.530659:0:25739:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.530680:0:25739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9196c21e8c00/0x84fc867ede519eb4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519ead expref: 23 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.530689:0:25739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583d1e200/0x84fc867ede519ec2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519ebb expref: 23 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.530696:0:25739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583d1e400/0x84fc867ede519f01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede519efa expref: 23 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.530702:0:25739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583d1f000/0x84fc867ede51a07b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51a074 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.530712:0:25739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583f46a00/0x84fc867ede51a1e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73010fc expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.530720:0:25739:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff919583f47800/0x84fc867ede51a226 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730116c expref: 12 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.530727:0:25739:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.530773:0:25739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583f47800/0x84fc867ede51a226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730116c expref: 12 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.530799:0:25739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583f47800/0x84fc867ede51a226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730116c expref: 12 pid: 22710 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428192.530813:0:25739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688821f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1876350940208128:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789428192.530907:0:25739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583f46a00/0x84fc867ede51a1e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73010fc expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.530915:0:25739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583f46a00/0x84fc867ede51a1e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73010fc expref: 12 pid: 22711 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428192.530922:0:25739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688823480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1876350940208256:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789428192.530948:0:25739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583d1f000/0x84fc867ede51a07b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede51a074 expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.530955:0:25739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583d1f000/0x84fc867ede51a07b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede51a074 expref: 23 pid: 22711 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428192.530966:0:25739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1876350940208384:0@lo:104: 00000100:00100000:3.0:1789428192.531006:0:25739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789428192.531046:0:25739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583d1e400/0x84fc867ede519f01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede519efa expref: 23 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.531055:0:25739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583d1e400/0x84fc867ede519f01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede519efa expref: 23 pid: 22709 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428192.531063:0:25739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688823b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1876350940208512:0@lo:104: 00000100:00100000:3.0:1789428192.531084:0:25739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789428192.531121:0:25739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff919583d1e200/0x84fc867ede519ec2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede519ebb expref: 23 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.531129:0:25739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff919583d1e200/0x84fc867ede519ec2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede519ebb expref: 23 pid: 22710 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428192.531137:0:25739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1876350940208640:0@lo:104: 00000100:00100000:0.0:1789428192.531280:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940208384 00000100:00100000:0.0:1789428192.531289:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940208384 00000100:00100000:0.0:1789428192.531330:0:22700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940208512 00000100:00100000:0.0:1789428192.531333:0:22700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940208512 00000100:00100000:0.0:1789428192.531348:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789428192.531357:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688823800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+4:25739:x1876350940208384:12345-0@lo:104: 00010000:00010000:0.0:1789428192.531377:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51a07b expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428192.531453:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789428192.531459:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688823800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+4:25739:x1876350940208384:12345-0@lo:104: Request processed in 104us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428192.531466:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789428192.531483:0:22700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789428192.531665:0:22700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+3:25739:x1876350940208512:12345-0@lo:104: 00010000:00010000:0.0:1789428192.531673:0:22700:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519f01 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428192.531710:0:22700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789428192.531715:0:22700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e871a47a-d8aa-4c92-86ef-047b0047c703+3:25739:x1876350940208512:12345-0@lo:104: Request processed in 55us (630us total) trans 0 rc 0/0 00010000:00010000:1.0:1789428192.533650:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789428192.533664:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede51a07b expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.533676:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680031000 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428192.533687:0:22705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede51a07b expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.533698:0:22705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede51a07b expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428192.533705:0:22705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede51a07b expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428192.533711:0:22705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789428192.533755:0:22705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51a07b expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.533762:0:22705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789428192.533786:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51a07b expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.533793:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a074 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede51a07b expref: -99 pid: 25034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.533810:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428192.533826:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519f01 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.533832:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919685209200 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:1.0:1789428192.533835:0:22705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519f01 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.533843:0:22705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519f01 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789428192.533849:0:22705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519f01 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789428192.533854:0:22705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789428192.533872:0:22705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519f01 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.533878:0:22705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789428192.533892:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519f01 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.533898:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919685209200/0x84fc867ede519efa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519f01 expref: -99 pid: 24216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.533909:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428192.533911:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428192.533913:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789428192.533937:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e871a47a-d8aa-4c92-86ef-047b0047c703:3614:1876350940208768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428192.534010:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428192.534072:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940208896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428192.534105:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428192.534148:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940208768 00000100:00100000:1.0:1789428192.534158:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940208768 00010000:00010000:1.0:1789428192.534188:0:22703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583d1f000/0x84fc867ede51a07b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51a074 expref: 24 pid: 22711 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428192.534216:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940208896 00000100:00100000:1.0:1789428192.534220:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940208896 00010000:00010000:1.0:1789428192.534232:0:22703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583d1e400/0x84fc867ede519f01 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519efa expref: 25 pid: 22709 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428192.534244:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428192.534287:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e871a47a-d8aa-4c92-86ef-047b0047c703+25:3614:x1876350940208768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428192.534301:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428192.534307:0:22703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583d1f000/0x84fc867ede51a07b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede51a074 expref: 25 pid: 22711 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.534318:0:22703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583d1f000/0x84fc867ede51a07b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede51a074 expref: 25 pid: 22711 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.534341:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428192.534380:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e871a47a-d8aa-4c92-86ef-047b0047c703+25:3614:x1876350940208768:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428192.534387:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789428192.534408:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428192.534438:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e871a47a-d8aa-4c92-86ef-047b0047c703+24:3615:x1876350940208896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789428192.534446:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428192.534450:0:22703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583d1e400/0x84fc867ede519f01 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519efa expref: 24 pid: 22709 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.534485:0:22703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583d1e400/0x84fc867ede519f01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede519efa expref: 24 pid: 22709 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.534496:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428192.534527:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e871a47a-d8aa-4c92-86ef-047b0047c703+24:3615:x1876350940208896:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428192.534533:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789428192.534594:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940208896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428192.534625:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e871a47a-d8aa-4c92-86ef-047b0047c703:3614:1876350940208768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428192.535149:0:22700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1789428192.535180:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428192.535549:0:25739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789428192.535743:0:25739:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9196c21e8c00/0x84fc867ede519eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x84fc867ede519ead expref: 23 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.535758:0:25739:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9196c21e8c00/0x84fc867ede519eb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x84fc867ede519ead expref: 23 pid: 22709 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428192.535769:0:25739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919688822680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1876350940209024:0@lo:104: 00000100:00100000:3.0:1789428192.535808:0:25739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428192.535823:0:25739:0:(client.c:2716:ptlrpc_set_wait()) set ffff9195810853c0 going to sleep for 11 seconds 00010000:00010000:3.0:1789428192.535840:0:25739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1f000/0x84fc867ede51a07b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede51a074 expref: 23 pid: 22711 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428192.535851:0:25739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1876350940208384:0@lo:104: 00010000:00010000:3.0:1789428192.535861:0:25739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1e400/0x84fc867ede519f01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede519efa expref: 22 pid: 22709 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428192.535868:0:25739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688823b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1876350940208512:0@lo:104: 00000100:00100000:0.0:1789428192.536064:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940208640 00000100:00100000:0.0:1789428192.536272:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940208640 00000100:00100000:0.0:1789428192.536308:0:22699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940209024 00000100:00100000:0.0:1789428192.536312:0:22699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940209024 00000100:00100000:0.0:1789428192.536326:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789428192.536334:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+4:25739:x1876350940208640:12345-0@lo:104: 00010000:00010000:0.0:1789428192.536347:0:22699:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519ec2 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428192.536409:0:22699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789428192.536443:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688820380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+4:25739:x1876350940208640:12345-0@lo:104: Request processed in 109us (5284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428192.536450:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789428192.536463:0:22699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789428192.536469:0:22699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688823100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+3:25739:x1876350940209024:12345-0@lo:104: 00010000:00010000:0.0:1789428192.536477:0:22699:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519eb4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428192.536512:0:22699:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789428192.536517:0:22699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688823100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+3:25739:x1876350940209024:12345-0@lo:104: Request processed in 48us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428192.536522:0:22699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789428192.536550:0:22705:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789428192.536556:0:22705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519ec2 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428192.536581:0:22705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fe00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:0.0:1789428192.536585:0:22705:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519ec2 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428192.536594:0:22705:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519ec2 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789428192.536602:0:22705:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519ec2 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428192.536607:0:22705:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789428192.536653:0:22705:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519ec2 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428192.536660:0:22705:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789428192.536688:0:22704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789428192.536688:0:22705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519ec2 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.536698:0:22704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x84fc867ede519eb4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428192.536700:0:22705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583d1fe00/0x84fc867ede519ebb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519ec2 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428192.536721:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428192.536723:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789428192.536724:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428192.536746:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e871a47a-d8aa-4c92-86ef-047b0047c703:3616:1876350940209152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428192.536781:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789428192.536789:0:22704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fc00 already unused, calling callback (ffffffffc118ec20) 10000000:00010000:2.0:1789428192.536794:0:22704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x84fc867ede519eb4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.536802:0:22704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x84fc867ede519eb4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789428192.536809:0:22704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x84fc867ede519eb4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428192.536815:0:22704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789428192.536840:0:22704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519eb4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.536847:0:22704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789428192.536871:0:22704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519eb4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.536877:0:22704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.124@tcp lock: ffff919583d1fc00/0x84fc867ede519ead lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x84fc867ede519eb4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.536891:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428192.536893:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428192.536895:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428192.537047:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bca29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e871a47a-d8aa-4c92-86ef-047b0047c703:3613:1876350940209280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789428192.537076:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428192.537334:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940209152 00000100:00100000:2.0:1789428192.537340:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940209152 00010000:00010000:2.0:1789428192.537363:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583d1e200/0x84fc867ede519ec2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519ebb expref: 22 pid: 22710 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428192.537400:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940209280 00000100:00100000:3.0:1789428192.537407:0:25739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688820000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1876350940208640:0@lo:104: 00000100:00100000:2.0:1789428192.537411:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940209280 00000100:00100000:3.0:1789428192.537445:0:25739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688822680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1876350940209024:0@lo:104: 00010000:00010000:2.0:1789428192.537446:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9196c21e8c00/0x84fc867ede519eb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519ead expref: 23 pid: 22709 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428192.537470:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789428192.537527:0:22702:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789428192.537535:0:22702:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789428192.537584:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+23:3616:x1876350940209152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428192.537631:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428192.537795:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583d1e200/0x84fc867ede519ec2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519ebb expref: 23 pid: 22710 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.537805:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583d1e200/0x84fc867ede519ec2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede519ebb expref: 23 pid: 22710 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.537820:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583d1e200/0x84fc867ede519ec2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede519ebb expref: 23 pid: 22710 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.537831:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428192.537883:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+22:3616:x1876350940209152:12345-0@lo:103:ldlm_bl.0 Request processed in 406us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428192.537891:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789428192.537913:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789428192.537919:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e871a47a-d8aa-4c92-86ef-047b0047c703:3616:1876350940209152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789428192.537924:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+21:3613:x1876350940209280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789428192.537934:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428192.537940:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9196c21e8c00/0x84fc867ede519eb4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x84fc867ede519ead expref: 21 pid: 22709 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.537948:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9196c21e8c00/0x84fc867ede519eb4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x84fc867ede519ead expref: 21 pid: 22709 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.538032:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9196c21e8c00/0x84fc867ede519eb4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x84fc867ede519ead expref: 21 pid: 22709 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.538043:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428192.538088:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e871a47a-d8aa-4c92-86ef-047b0047c703+20:3613:x1876350940209280:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428192.538104:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789428192.538137:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bca29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e871a47a-d8aa-4c92-86ef-047b0047c703:3613:1876350940209280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789428192.543808:0:25739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688821f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1876350940208128:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789428192.553076:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428192.553158:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428192.553612:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931723264 00000100:00100000:0.0:1789428192.553622:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931723264 00010000:00010000:0.0:1789428192.553674:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583f46a00/0x84fc867ede51a1e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73010fc expref: 13 pid: 22711 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428192.553718:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931723136 00000100:00100000:0.0:1789428192.553721:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931723136 00010000:00010000:0.0:1789428192.553735:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff919583f47800/0x84fc867ede51a226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730116c expref: 14 pid: 22710 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428192.553760:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 13 00000100:00100000:0.0:1789428192.553771:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9195836c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e26acd45-ce12-4c56-8027-8ae3c1aab989+14:2396:x1876350931723264:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789428192.553786:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428192.553792:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583f46a00/0x84fc867ede51a1e7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73010fc expref: 14 pid: 22711 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428192.553804:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583f46a00/0x84fc867ede51a1e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73010fc expref: 14 pid: 22711 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428192.554127:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 14 00000100:00100000:3.0:1789428192.554147:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e26acd45-ce12-4c56-8027-8ae3c1aab989+14:2397:x1876350931723136:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789428192.554157:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428192.554162:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff919583f47800/0x84fc867ede51a226 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730116c expref: 14 pid: 22710 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.554334:0:25739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f46a00/0x84fc867ede51a1e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73010fc expref: 14 pid: 22711 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428192.554350:0:25739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919688823480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25739:1876350940208256:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789428192.559074:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff919583f47800/0x84fc867ede51a226 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730116c expref: 13 pid: 22710 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.559103:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583f47800/0x84fc867ede51a226 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730116c expref: 13 pid: 22710 timeout: 637 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.559121:0:22701:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428192.559129:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.559729:0:22701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.559739:0:22701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.559748:0:22701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.559755:0:22701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.559761:0:22701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428200 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428192.559766:0:22701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.559774:0:22701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.559784:0:22701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.559815:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428192.559890:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e26acd45-ce12-4c56-8027-8ae3c1aab989+12:2397:x1876350931723136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 5752us (6730us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428192.559900:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 14 00010000:00010000:0.0:1789428192.563915:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789428192.564057:0:25739:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428192.564126:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9195836c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:2396:x1876350931723264:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 10350us (11054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428192.564140:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 13 00000001:00100000:3.0:1789428192.564163:0:25035:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6def47a4-6189-4bdd-97b7-d460dc95e7fc 00010000:00010000:2.0:1789428192.564371:0:25739:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.564382:0:25739:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428192.564390:0:25739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff919583428200/0x84fc867ede51a257 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25739 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428192.695602:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428193.073013:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940209408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789428193.073104:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428193.073373:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940209408 00000100:00100000:2.0:1789428193.073383:0:24225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940209408 00000100:00080000:0.0:1789428193.073468:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789428193.073470:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789428193.073479:0:24225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940209408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789428193.073510:0:24225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789428193.073569:0:24225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940209408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428193.073577:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789428193.073667:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940209408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789428193.712677:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428193.880672:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428193.880798:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931723392 00000100:00100000:0.0:1789428193.880809:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931723392 00000100:00100000:0.0:1789428193.880890:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:0.0:1789428193.880910:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b6b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:18653:x1876350931723392:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789428193.880932:0:24790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428193.880955:0:24790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a25e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73011a4 expref: -99 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881045:0:24790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a265 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881066:0:24790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a265 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881078:0:24790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a265 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881092:0:24790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a26c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881099:0:24790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a26c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881106:0:24790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a26c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881185:0:24790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964200/0x84fc867ede51a273 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881193:0:24790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699964200/0x84fc867ede51a273 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881200:0:24790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964200/0x84fc867ede51a273 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428193.881255:0:24790:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789428193.881260:0:24790:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789428193.881298:0:24790:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919699964200/0x84fc867ede51a273 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881308:0:24790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a265 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881315:0:24790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a265 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881321:0:24790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a265 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881326:0:24790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428193.881329:0:24790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a265 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881336:0:24790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a265 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881346:0:24790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f900) 00010000:00010000:0.0:1789428193.881349:0:24790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428193.881354:0:24790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a265 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881359:0:24790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a265 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881374:0:24790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a26c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881392:0:24790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a26c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881398:0:24790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a26c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881403:0:24790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428193.881407:0:24790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a26c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881501:0:24790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a26c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881511:0:24790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9196a235fe00) 00010000:00010000:0.0:1789428193.881515:0:24790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428193.881519:0:24790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a26c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881526:0:24790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a26c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881572:0:24790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a25e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011a4 expref: 8 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881587:0:24790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964200/0x84fc867ede51a273 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011a4 expref: 7 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.881594:0:24790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:0.0:1789428193.881596:0:24790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789428193.881604:0:24790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699964200, rc 0) 00000100:00100000:0.0:1789428193.881668:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b6b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:18653:x1876350931723392:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 761us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428193.881676:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23 00000100:00100000:3.0:1789428193.883811:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428193.884355:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931723520 00000100:00100000:0.0:1789428193.884369:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931723520 00000100:00100000:0.0:1789428193.884451:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:0.0:1789428193.884460:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:18653:x1876350931723520:12345-192.168.202.24@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789428193.884549:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688823480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:18653:x1876350931723520:12345-192.168.202.24@tcp:900:lhsmtool_posix.0 Request processed in 89us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428193.884557:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00080000:2.0:1789428193.884636:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789428193.889771:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428193.889912:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931723776 00000100:00100000:2.0:1789428193.889928:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931723776 00000100:00100000:2.0:1789428193.890005:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:2.0:1789428193.890020:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:18653:x1876350931723776:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789428193.890076:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428193.890109:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a27a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73011ab expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890231:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a281 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890263:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a281 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890277:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a281 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890307:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51a288 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890316:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51a288 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890323:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51a288 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890528:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813edc00/0x84fc867ede51a28f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890537:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813edc00/0x84fc867ede51a28f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890545:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813edc00/0x84fc867ede51a28f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428193.890556:0:22718:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789428193.890775:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a281 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890784:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a281 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890791:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a281 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890798:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428193.890804:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a281 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890814:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a281 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890830:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9196a235fd00) 00010000:00010000:2.0:1789428193.890833:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428193.890841:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a281 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890847:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a281 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890863:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51a288 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890869:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51a288 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890875:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51a288 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890890:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428193.890893:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51a288 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890900:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51a288 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890908:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91969297a000) 00010000:00010000:2.0:1789428193.890911:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428193.890913:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51a288 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.890918:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed200/0x84fc867ede51a288 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.891776:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a27a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ab expref: 10 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.891797:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813edc00/0x84fc867ede51a28f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ab expref: 9 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428193.891806:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91969297a200) 00010000:00010000:2.0:1789428193.891809:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428193.891812:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813edc00, rc 0) 00000100:00100000:2.0:1789428193.891902:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688821f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+9:18653:x1876350931723776:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 1884us (2144us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1789428193.891911:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:3.0:1789428193.904058:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428193.904214:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931723904 00000100:00100000:2.0:1789428193.904254:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931723904 00000100:00100000:2.0:1789428193.904341:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:2.0:1789428193.904355:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+9:18653:x1876350931723904:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789428193.904550:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688822680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+9:18653:x1876350931723904:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 Request processed in 198us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428193.904558:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:3.0:1789428193.912728:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428193.913461:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931724032 00000100:00100000:1.0:1789428193.913477:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931724032 00000100:00100000:1.0:1789428193.913576:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:1.0:1789428193.913591:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:18653:x1876350931724032:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1789428193.913735:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1789428193.917381:0:22717:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3731us 00000100:00100000:0.0:1789428193.941853:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688820000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:18653:x1876350931724032:12345-192.168.202.24@tcp:59:lhsmtool_posix.0 Request processed in 28252us (29124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428193.941871:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:2.0:1789428193.950666:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428193.950781:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931724160 00000100:00100000:0.0:1789428193.950795:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931724160 00000100:00100000:0.0:1789428193.950866:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:0.0:1789428193.950879:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b6b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+9:18659:x1876350931724160:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789428193.950909:0:24790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428193.950936:0:24790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a29d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73011b2 expref: -99 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951025:0:24790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a2a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951038:0:24790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a2a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951067:0:24790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a2a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951082:0:24790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951087:0:24790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951091:0:24790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951135:0:24790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a2a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951872:0:24790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a2a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951880:0:24790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a2a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951888:0:24790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965c00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428193.951893:0:24790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a2a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951903:0:24790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a2a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951917:0:24790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f900) 00010000:00010000:0.0:1789428193.951920:0:24790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428193.951925:0:24790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a2a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951941:0:24790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a2a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951957:0:24790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951962:0:24790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951966:0:24790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951968:0:24790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428193.951970:0:24790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951973:0:24790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951977:0:24790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9196a235fe00) 00010000:00010000:0.0:1789428193.951979:0:24790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428193.951980:0:24790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.951983:0:24790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.952032:0:24790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a29d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011b2 expref: 10 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.952048:0:24790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f900) 00010000:00010000:0.0:1789428193.952049:0:24790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428193.952052:0:24790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a29d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011b2 expref: 10 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.952061:0:24790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699964400, rc 0) 00000100:00100000:0.0:1789428193.952134:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b6b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+9:18659:x1876350931724160:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 1257us (1484us total) trans 0 rc 301/301 00000100:00100000:0.0:1789428193.952151:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:0.0:1789428193.955668:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428193.955843:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931724288 00000100:00100000:1.0:1789428193.955857:0:22725:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931724288 00000100:00100000:1.0:1789428193.955958:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:1.0:1789428193.955972:0:22725:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+9:18659:x1876350931724288:12345-192.168.202.24@tcp:700:lfs.0 00000100:00100000:1.0:1789428193.956124:0:22725:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+9:18659:x1876350931724288:12345-192.168.202.24@tcp:700:lfs.0 Request processed in 155us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428193.956134:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:3.0:1789428193.957687:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428193.957774:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931724544 00000100:00100000:0.0:1789428193.957784:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931724544 00000100:00100000:0.0:1789428193.957841:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:0.0:1789428193.957853:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+9:18659:x1876350931724544:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:0.0:1789428193.957918:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428193.957950:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a211 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730112d expref: 9 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.957972:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f900) 00010000:00010000:0.0:1789428193.957977:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789428193.958101:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.958115:0:22718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ece00/0x84fc867ede51a250 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730119d expref: 5 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.958141:0:22718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.958193:0:22718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ece00/0x84fc867ede51a250 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730119d expref: 5 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.958210:0:22718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ece00/0x84fc867ede51a250 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730119d expref: 5 pid: 22718 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428193.958231:0:22718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22718:1876350940209536:192.168.202.24@tcp:104: 00000100:00100000:0.0:1789428193.958382:0:22718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adb37d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789428193.961030:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428193.961120:0:25741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931724672 00000100:00100000:3.0:1789428193.961133:0:25741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931724672 00010000:00010000:3.0:1789428193.961220:0:25741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ece00/0x84fc867ede51a250 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730119d expref: 6 pid: 22718 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428193.961281:0:25741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 15 00000100:00080000:2.0:1789428193.961456:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789428193.961581:0:25741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b6b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:2397:x1876350931724672:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789428193.961603:0:25741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428193.961613:0:25741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ece00/0x84fc867ede51a250 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730119d expref: 6 pid: 22718 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428193.961629:0:25741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ece00/0x84fc867ede51a250 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730119d expref: 6 pid: 22718 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428193.961660:0:25741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f900) 00010000:00010000:3.0:1789428193.961667:0:25741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428193.961679:0:25741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428193.961688:0:25741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428193.961713:0:25741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428193.961871:0:25741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b6b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:2397:x1876350931724672:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 579us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428193.961880:0:25741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 15 00010000:00010000:0.0:1789428193.962077:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ece00/0x84fc867ede51a250 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730119d expref: 5 pid: 22718 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428193.962097:0:22718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22718:1876350940209536:192.168.202.24@tcp:104: 00010000:00010000:0.0:1789428193.962126:0:22718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.962136:0:22718:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.962155:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.962491:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a2b9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.962506:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.962525:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.964550:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2c0 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.964579:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.964593:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789428193.964614:0:22718:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000adb9908a reply state 0000000076eb3e2a transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2c0 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.964627:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2c0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.964634:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9196a235f300) 00010000:00010000:0.0:1789428193.964637:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789428193.964643:0:22718:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789428193.964650:0:22718:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789428193.964659:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.964665:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.964672:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.964679:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428193.964693:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.964702:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.964715:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9196a235f900) 00010000:00010000:0.0:1789428193.964717:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428193.964721:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.964728:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a2b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789428193.964749:0:22718:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000adb9908a reply state 0000000076eb3e2a transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.964757:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a2b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428193.964763:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9196a235fe00) 00010000:00010000:0.0:1789428193.964765:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789428193.964767:0:22718:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789428193.964880:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688823b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+10:18659:x1876350931724544:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 7024us (7196us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1789428193.964890:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 28 00000100:00100000:3.0:1789428194.021587:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428194.021714:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931724800 00000100:00100000:2.0:1789428194.021729:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931724800 00000100:00100000:2.0:1789428194.021805:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:2.0:1789428194.021818:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919688820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+10:18668:x1876350931724800:12345-192.168.202.24@tcp:101:lctl.0 00010000:00010000:2.0:1789428194.021852:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428194.021886:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a2c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73011b9 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.021975:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51a2ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.021992:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51a2ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.022007:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51a2ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428194.022072:0:22716:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789428194.022094:0:22716:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789428194.022168:0:22716:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51a2ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.022199:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a2c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011b9 expref: 12 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.022224:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec800/0x84fc867ede51a2ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011b9 expref: 11 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.022242:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969297a000) 00010000:00010000:2.0:1789428194.022245:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789428194.022249:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ec800, rc 0) 00000100:00100000:2.0:1789428194.022350:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919688820700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+11:18668:x1876350931724800:12345-192.168.202.24@tcp:101:lctl.0 Request processed in 535us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.022359:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 29 00000100:00100000:0.0:1789428194.042046:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428194.042151:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931724928 00000100:00100000:2.0:1789428194.042175:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931724928 00000100:00100000:2.0:1789428194.042256:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:2.0:1789428194.042272:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+5:18669:x1876350931724928:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789428194.042310:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428194.042342:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a2d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73011c0 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.042638:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eca00/0x84fc867ede51a2dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.042656:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eca00/0x84fc867ede51a2dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.042690:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eca00/0x84fc867ede51a2dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428194.042752:0:22717:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789428194.042756:0:22717:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789428194.042783:0:22717:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eca00/0x84fc867ede51a2dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.042810:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a2d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011c0 expref: 7 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.042831:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eca00/0x84fc867ede51a2dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011c0 expref: 6 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.042840:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969297a000) 00010000:00010000:2.0:1789428194.042843:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789428194.042847:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813eca00, rc 0) 00000100:00100000:2.0:1789428194.043023:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:18669:x1876350931724928:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 757us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.043030:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30 00000100:00100000:3.0:1789428194.045757:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428194.045849:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931725056 00000100:00100000:2.0:1789428194.045861:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931725056 00000100:00100000:2.0:1789428194.045930:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:2.0:1789428194.045942:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:18669:x1876350931725056:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789428194.045966:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428194.045990:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a2e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73011c7 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046098:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a2ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046114:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a2ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046127:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a2ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046153:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a2f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046170:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a2f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046178:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a2f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046302:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a2f8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046311:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a2f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046317:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a2f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428194.046365:0:22716:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789428194.046369:0:22716:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789428194.046392:0:22716:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a2f8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046445:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a2ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046453:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a2ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046460:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a2ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046466:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428194.046472:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a2ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046480:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a2ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046494:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969297a000) 00010000:00010000:2.0:1789428194.046497:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428194.046503:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a2ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046509:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a2ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046524:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a2f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046530:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a2f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046535:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a2f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046545:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428194.046548:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a2f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046554:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a2f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046562:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9196a235fe00) 00010000:00010000:2.0:1789428194.046565:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428194.046568:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a2f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046574:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a2f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046603:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a2e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011c7 expref: 8 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046619:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a2f8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011c7 expref: 7 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.046626:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9196a235f300) 00010000:00010000:2.0:1789428194.046628:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789428194.046631:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed000, rc 0) 00000100:00100000:2.0:1789428194.046716:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+7:18669:x1876350931725056:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 776us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.046724:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31 00000100:00100000:3.0:1789428194.049345:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.049468:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931725184 00000100:00100000:0.0:1789428194.049479:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931725184 00000100:00100000:0.0:1789428194.049563:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:0.0:1789428194.049575:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+5:18669:x1876350931725184:12345-192.168.202.24@tcp:900:lfs.0 00000100:00100000:0.0:1789428194.049684:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+5:18669:x1876350931725184:12345-192.168.202.24@tcp:900:lfs.0 Request processed in 111us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428194.049692:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00080000:2.0:1789428194.049908:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789428194.053676:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.053783:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931725440 00000100:00100000:0.0:1789428194.053794:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931725440 00000100:00100000:0.0:1789428194.053879:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:0.0:1789428194.053888:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6def47a4-6189-4bdd-97b7-d460dc95e7fc+7:18669:x1876350931725440:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789428194.053911:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428194.053935:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a2ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73011ce expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428194.054048:0:22718:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789428194.054190:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a2ff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ce expref: 9 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.054207:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969297a000) 00010000:00010000:0.0:1789428194.054211:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789428194.054215:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a2ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ce expref: 9 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.054240:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965a00, rc 0) 00000100:00100000:0.0:1789428194.054396:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6def47a4-6189-4bdd-97b7-d460dc95e7fc+8:18669:x1876350931725440:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 509us (734us total) trans 12884901891 rc 301/301 00000100:00100000:0.0:1789428194.054405:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 32 00000100:00100000:0.0:1789428194.056668:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428194.056783:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931725696 00000100:00100000:2.0:1789428194.056794:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931725696 00000100:00100000:2.0:1789428194.056847:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:2.0:1789428194.056855:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+8:18669:x1876350931725696:12345-192.168.202.24@tcp:36:lfs.0 00010000:00010000:2.0:1789428194.056910:0:22716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428194.056938:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a2f8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011c7 expref: 8 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.056955:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9196a235f300) 00010000:00010000:2.0:1789428194.056960:0:22716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789428194.056980:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a30d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.056994:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a30d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.057002:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a30d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789428194.057280:0:22716:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cff4d1f8 reply state 00000000fab0a05a transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a30d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.057506:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a30d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.057515:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9196a235f300) 00010000:00010000:2.0:1789428194.057518:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789428194.057521:0:22716:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789428194.057531:0:22716:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789428194.057657:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+9:18669:x1876350931725696:12345-192.168.202.24@tcp:36:lfs.0 Request processed in 801us (1001us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789428194.057681:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33 00000100:00100000:3.0:1789428194.059135:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.059279:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931725952 00000100:00100000:0.0:1789428194.059307:0:22720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931725952 00000100:00100000:1.0:1789428194.059456:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:1.0:1789428194.059544:0:22719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+9:18669:x1876350931725952:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:1.0:1789428194.059774:0:22719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+10:18669:x1876350931725952:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 234us (647us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1789428194.059782:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:3.0:1789428194.061325:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428194.061462:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931726208 00000100:00100000:2.0:1789428194.061473:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931726208 00000100:00100000:2.0:1789428194.061526:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:2.0:1789428194.061536:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+10:18669:x1876350931726208:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789428194.061562:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428194.061587:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a314 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73011d5 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061660:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a31b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061674:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a31b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061684:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a31b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061693:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a322 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061697:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061702:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428194.061813:0:22717:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789428194.061883:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a31b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061904:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a31b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061910:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a31b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061914:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428194.061918:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a31b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061924:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a31b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061934:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969297a000) 00010000:00010000:2.0:1789428194.061936:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428194.061940:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a31b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061944:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec000/0x84fc867ede51a31b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061956:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a322 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061961:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a322 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061966:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a322 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061971:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428194.061979:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a322 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061985:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a322 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.061993:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9196a235fe00) 00010000:00010000:2.0:1789428194.061996:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428194.061999:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a322 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.062004:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a322 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.062044:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a314 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011d5 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.062054:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969297a000) 00010000:00010000:2.0:1789428194.062056:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789428194.062059:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a314 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011d5 expref: 12 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.062067:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ecc00, rc 0) 00000100:00100000:2.0:1789428194.064058:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+11:18669:x1876350931726208:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 2505us (2722us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1789428194.064073:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34 00000100:00100000:0.0:1789428194.067905:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428194.068008:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931726336 00000100:00100000:2.0:1789428194.068022:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931726336 00000100:00100000:2.0:1789428194.068100:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:2.0:1789428194.068111:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+11:18669:x1876350931726336:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:2.0:1789428194.068175:0:24790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428194.068205:0:24790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a330 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73011dc expref: -99 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.068368:0:24790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a337 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.068388:0:24790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a337 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.068404:0:24790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a337 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428194.068660:0:24790:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789428194.068667:0:24790:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789428194.068692:0:24790:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a337 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.068729:0:24790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a330 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011dc expref: 13 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.068750:0:24790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a337 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011dc expref: 12 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.068760:0:24790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9196a235f300) 00010000:00010000:2.0:1789428194.068763:0:24790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789428194.068767:0:24790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ec600, rc 0) 00000100:00100000:2.0:1789428194.068850:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+12:18669:x1876350931726336:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 739us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.068858:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 35 00000100:00100000:3.0:1789428194.072546:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.072639:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931726464 00000100:00100000:0.0:1789428194.072653:0:22720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931726464 00000100:00100000:0.0:1789428194.072774:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:0.0:1789428194.072787:0:22720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+12:18669:x1876350931726464:12345-192.168.202.24@tcp:37:lfs.0 00000100:00100000:1.0:1789428194.076299:0:22720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6def47a4-6189-4bdd-97b7-d460dc95e7fc+12:18669:x1876350931726464:12345-192.168.202.24@tcp:37:lfs.0 Request processed in 3494us (3745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428194.076318:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 3 00000100:00100000:3.0:1789428194.078796:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428194.078866:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931726720 00000100:00100000:1.0:1789428194.078878:0:22719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931726720 00000100:00100000:1.0:1789428194.078943:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:1.0:1789428194.078956:0:22719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc0a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+12:18669:x1876350931726720:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:1.0:1789428194.079319:0:22719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc0a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6def47a4-6189-4bdd-97b7-d460dc95e7fc+13:18669:x1876350931726720:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 364us (533us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1789428194.079328:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 4 00000100:00100000:3.0:1789428194.083648:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.084366:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931726848 00000100:00100000:0.0:1789428194.084382:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931726848 00000100:00100000:0.0:1789428194.084656:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 142 00000100:00100000:0.0:1789428194.084671:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+11:18034:x1876350931726848:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428194.084693:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428194.084722:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919699965400/0x84fc867ede51a33e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f73011e3 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.084761:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919699965400/0x84fc867ede51a33e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011e3 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.084774:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919699965400/0x84fc867ede51a33e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011e3 expref: 12 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.084784:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965400, rc 0) 00000100:00100000:0.0:1789428194.084866:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+12:18034:x1876350931726848:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 199us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428194.084874:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 142 00000100:00100000:0.0:1789428194.089914:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428194.090034:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931726976 00000100:00100000:1.0:1789428194.090057:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931726976 00000100:00100000:1.0:1789428194.090128:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 143 00000100:00100000:1.0:1789428194.090148:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+12:18034:x1876350931726976:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789428194.090398:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+12:18034:x1876350931726976:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 259us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428194.090485:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 143 00000100:00100000:3.0:1789428194.093613:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428194.093819:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931727104 00000100:00100000:1.0:1789428194.093833:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931727104 00000100:00100000:1.0:1789428194.093905:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 144 00000100:00100000:1.0:1789428194.093918:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+12:18034:x1876350931727104:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789428194.094923:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e26acd45-ce12-4c56-8027-8ae3c1aab989+12:18034:x1876350931727104:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 997us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428194.094937:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 144 00000100:00100000:0.0:1789428194.103459:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940209664:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.103560:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.103630:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940210176:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.103659:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.103678:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940210688:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.103697:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.103710:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940211200:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.103730:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.103754:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789428194.103760:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940209792:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.103787:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.103807:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940210304:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.103829:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.103844:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940210816:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.103864:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.103895:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940209792 00000100:00100000:0.0:1789428194.103905:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940209792 00000100:00100000:0.0:1789428194.103956:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940210304 00000100:00100000:0.0:1789428194.103959:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940210304 00000100:00100000:0.0:1789428194.103977:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789428194.103987:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940209792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428194.104287:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940210176 00000100:00100000:3.0:1789428194.104291:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940210176 00000100:00100000:3.0:1789428194.104314:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940210688 00000100:00100000:3.0:1789428194.104316:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940210688 00000100:00100000:3.0:1789428194.104327:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940211200 00000100:00100000:3.0:1789428194.104329:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940211200 00000100:00100000:3.0:1789428194.104350:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940210816 00000100:00100000:3.0:1789428194.104353:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940210816 00000100:00100000:3.0:1789428194.104366:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789428194.104373:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940210176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428194.104440:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1876350940210176:12345-0@lo:400:kworker.0 Request processed in 67us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.104447:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789428194.104468:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789428194.104474:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940210688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428194.104502:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1876350940210688:12345-0@lo:400:kworker.0 Request processed in 29us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.104508:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789428194.104532:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789428194.104539:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940211200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428194.104567:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1876350940211200:12345-0@lo:400:kworker.0 Request processed in 29us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.104573:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789428194.104583:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789428194.104590:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940210816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428194.104616:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1876350940210816:12345-0@lo:400:kworker.0 Request processed in 27us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.104622:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789428194.104719:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940209792:12345-0@lo:400:kworker.0 Request processed in 733us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428194.104728:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789428194.104744:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789428194.104751:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940210304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.104782:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940210304:12345-0@lo:400:kworker.0 Request processed in 32us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428194.104798:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789428194.104824:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940210048:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.104859:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.104884:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940210560:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.104906:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.104922:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940211072:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.104943:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.104959:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789428194.104966:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940209920:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.104984:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.104998:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940210432:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.105016:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.105029:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940210944:0@lo:400:kworker.0 00000100:00100000:2.0:1789428194.105335:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940211328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789428194.105369:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428194.105442:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940210048 00000100:00100000:2.0:1789428194.105448:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940210048 00000100:00100000:2.0:1789428194.105489:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940210560 00000100:00100000:2.0:1789428194.105492:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940210560 00000100:00100000:2.0:1789428194.105508:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940209920 00000100:00100000:2.0:1789428194.105511:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940209920 00000100:00100000:2.0:1789428194.105522:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940210432 00000100:00100000:2.0:1789428194.105525:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940210432 00000100:00100000:2.0:1789428194.105541:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789428194.105548:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940210048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428194.105584:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940210048:12345-0@lo:400:kworker.0 Request processed in 37us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.105590:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789428194.105603:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789428194.105610:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940210560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428194.105647:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940210560:12345-0@lo:400:kworker.0 Request processed in 38us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.105653:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789428194.105664:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789428194.105670:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940209920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428194.105696:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940209920:12345-0@lo:400:kworker.0 Request processed in 27us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.105702:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789428194.105713:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789428194.105719:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940210432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789428194.105759:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1876350940210432:12345-0@lo:400:kworker.0 Request processed in 41us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.105766:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789428194.105796:0:3613:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196b6b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940211456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789428194.105823:0:3613:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428194.105853:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940211328 00000100:00100000:2.0:1789428194.105857:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940211328 00000100:00100000:2.0:1789428194.105875:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940211456 00000100:00100000:2.0:1789428194.105877:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940211456 00000100:00100000:2.0:1789428194.105889:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789428194.105895:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b6b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940211328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789428194.105911:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789428194.105948:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b6b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1876350940211328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.105954:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789428194.105965:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789428194.105971:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b6b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940211456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789428194.105988:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1789428194.106016:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b6b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3613:x1876350940211456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.106022:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789428194.106291:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940209664 00000100:00100000:1.0:1789428194.106295:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940209664 00000100:00100000:1.0:1789428194.106324:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789428194.106331:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+20:3615:x1876350940209664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428194.106369:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+20:3615:x1876350940209664:12345-0@lo:400:kworker.0 Request processed in 40us (2811us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428194.106375:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789428194.106409:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940211072 00000100:00100000:1.0:1789428194.106446:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940211072 00000100:00100000:1.0:1789428194.106506:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789428194.106512:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940211072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789428194.106543:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1876350940211072:12345-0@lo:400:kworker.0 Request processed in 31us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428194.106550:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789428194.106603:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940209792:0@lo:400:kworker.0 00000100:00100000:1.0:1789428194.106618:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940210304:0@lo:400:kworker.0 00000100:00100000:1.0:1789428194.106664:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3615:1876350940210816:0@lo:400:kworker.0 00000100:00100000:1.0:1789428194.106674:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e871a47a-d8aa-4c92-86ef-047b0047c703:3615:1876350940209664:0@lo:400:kworker.0 00000100:00100000:1.0:1789428194.106685:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3615:1876350940210176:0@lo:400:kworker.0 00000100:00100000:1.0:1789428194.106697:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3615:1876350940210688:0@lo:400:kworker.0 00010000:00080000:1.0:1789428194.106719:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196ad928380 x1876350940211200/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789428194.106730:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3615:1876350940211200:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.107437:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.107477:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940210048:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.107494:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940210560:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.107507:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3614:1876350940211072:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.107533:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940211584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789428194.107564:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.107605:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940209920:0@lo:400:kworker.0 00000100:00100000:0.0:1789428194.107620:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bfaa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3614:1876350940210432:0@lo:400:kworker.0 00000100:00100000:3.0:1789428194.107949:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940210944 00000100:00100000:3.0:1789428194.107958:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940210944 00000100:00100000:3.0:1789428194.108002:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789428194.108011:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940210944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789428194.108077:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1876350940210944:12345-0@lo:400:kworker.0 Request processed in 67us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.108084:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789428194.109385:0:3613:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196b6b65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3613:1876350940211456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789428194.109475:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3616:1876350940211328:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789428194.109567:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9196ad929c00 x1876350940210944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789428210 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789428194.109606:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad929c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3614:1876350940210944:0@lo:400:kworker.0 00000100:00100000:3.0:1789428194.112474:0:24225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940211584 00000100:00100000:3.0:1789428194.112501:0:24225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940211584 00000100:00100000:3.0:1789428194.112575:0:24225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789428194.112589:0:24225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940211584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789428194.112624:0:24225:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915857920 avail 3684335616 00000100:00080000:0.0:1789428194.112943:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789428194.112951:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789428194.112956:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789428194.112960:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789428194.118697:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.119268:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931727232 00000100:00100000:0.0:1789428194.119284:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931727232 00000100:00100000:3.0:1789428194.119696:0:24225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940211584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7106us (12127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.119711:0:24225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789428194.119884:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940211584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789428194.119998:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 146 00000100:00100000:1.0:1789428194.120014:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+12:18034:x1876350931727232:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428194.120033:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428194.120306:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f46a00/0x84fc867ede51a345 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1f632749f73011ea expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.120489:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f46a00/0x84fc867ede51a345 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ea expref: 13 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.120506:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f46a00/0x84fc867ede51a345 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ea expref: 13 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.120518:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46a00, rc 0) 00000100:00100000:1.0:1789428194.120658:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18034:x1876350931727232:12345-192.168.202.24@tcp:101:ll_cfg_requeue.0 Request processed in 648us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428194.120666:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 146 00000100:00100000:0.0:1789428194.128022:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428194.128220:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931727360 00000100:00100000:3.0:1789428194.128261:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931727360 00000100:00100000:3.0:1789428194.128337:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 147 00000100:00100000:3.0:1789428194.128350:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18034:x1876350931727360:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789428194.128605:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18034:x1876350931727360:12345-192.168.202.24@tcp:501:ll_cfg_requeue.0 Request processed in 257us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.128613:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 147 00000100:00100000:3.0:1789428194.132191:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428194.132346:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931727488 00000100:00100000:1.0:1789428194.132361:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931727488 00000100:00100000:1.0:1789428194.132483:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 148 00000100:00100000:1.0:1789428194.132496:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18034:x1876350931727488:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789428194.132946:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:18034:x1876350931727488:12345-192.168.202.24@tcp:503:ll_cfg_requeue.0 Request processed in 451us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428194.132956:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 148 00000100:00100000:1.0:1789428194.136902:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428194.137097:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931727616 00000100:00100000:3.0:1789428194.137112:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931727616 00000100:00100000:3.0:1789428194.137198:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:3.0:1789428194.137213:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+11:18676:x1876350931727616:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:3.0:1789428194.137255:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428194.137298:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51a34c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73011f1 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.137391:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a353 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.137409:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a353 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.137455:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a353 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.137470:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51a35a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.137478:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51a35a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.137507:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51a35a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.137971:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede51a361 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.137983:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede51a361 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.137992:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede51a361 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789428194.138042:0:22716:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789428194.138047:0:22716:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789428194.138099:0:22716:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede51a361 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138115:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a353 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138123:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a353 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138130:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a353 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138136:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789428194.138142:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a353 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138150:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a353 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138174:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969297a000) 00010000:00010000:3.0:1789428194.138177:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789428194.138185:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a353 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138192:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a353 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138209:0:22716:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51a35a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138216:0:22716:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51a35a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138222:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51a35a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138227:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789428194.138230:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51a35a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138249:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51a35a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138257:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9196a235fe00) 00010000:00010000:3.0:1789428194.138259:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789428194.138262:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51a35a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138268:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429800/0x84fc867ede51a35a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138314:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51a34c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011f1 expref: 13 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138331:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429400/0x84fc867ede51a361 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011f1 expref: 12 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.138338:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9196a235f300) 00010000:00010000:3.0:1789428194.138341:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789428194.138344:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429400, rc 0) 00000100:00100000:3.0:1789428194.139036:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+12:18676:x1876350931727616:12345-192.168.202.24@tcp:101:bash.0 Request processed in 1822us (2145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.139047:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 36 00000100:00100000:0.0:1789428194.148867:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428194.148953:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931727744 00000100:00100000:2.0:1789428194.148988:0:22727:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931727744 00000100:00100000:2.0:1789428194.149066:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:2.0:1789428194.149079:0:22727:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:18676:x1876350931727744:12345-192.168.202.24@tcp:900:bash.0 00000100:00100000:2.0:1789428194.149753:0:22727:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:18676:x1876350931727744:12345-192.168.202.24@tcp:900:bash.0 Request processed in 674us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.149761:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:1.0:1789428194.151985:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428194.152064:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931728000 00000100:00100000:2.0:1789428194.152078:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931728000 00000100:00100000:2.0:1789428194.152149:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:2.0:1789428194.152175:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+12:18676:x1876350931728000:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:2.0:1789428194.152201:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428194.152228:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a368 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73011f8 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.152388:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.152407:0:22717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a337 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011dc expref: 12 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.152456:0:22717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.152499:0:22717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a337 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011dc expref: 12 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.152516:0:22717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a337 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011dc expref: 12 pid: 24790 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428194.152551:0:22717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196b6b65880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22717:1876350940211712:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789428194.152646:0:22717:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9840 going to sleep for 11 seconds 00000100:00100000:2.0:1789428194.154566:0:22717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196b6b65880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22717:1876350940211712:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789428194.154600:0:22717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428194.155950:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.159739:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931728128 00000100:00100000:0.0:1789428194.159763:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931728128 00010000:00010000:0.0:1789428194.159902:0:22703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a337 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011dc expref: 13 pid: 24790 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428194.159971:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 16 00000100:00100000:0.0:1789428194.159983:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6def47a4-6189-4bdd-97b7-d460dc95e7fc+13:2396:x1876350931728128:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789428194.160005:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428194.160013:0:22703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a337 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011dc expref: 13 pid: 24790 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.160029:0:22703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a337 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011dc expref: 13 pid: 24790 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.160056:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a337 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011dc expref: 13 pid: 24790 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.160077:0:22703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9196a235f300) 00010000:00010000:0.0:1789428194.160100:0:22703:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.160112:0:22703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.160122:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.160325:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789428194.160458:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6def47a4-6189-4bdd-97b7-d460dc95e7fc+12:2396:x1876350931728128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 435us (4474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428194.160468:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 16 00000040:00080000:2.0:1789428194.163505:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789428194.166779:0:22717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.166803:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.166936:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51a376 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.166955:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51a376 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.166970:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51a376 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.168047:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede51a37d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.168068:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede51a37d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.168101:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede51a37d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789428194.168119:0:22717:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789428194.168157:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.168166:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.168174:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.168181:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789428194.168187:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.168195:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.168211:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9196a235f300) 00010000:00010000:1.0:1789428194.168214:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789428194.168220:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.168226:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a36f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789428194.168254:0:22717:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f02e722d reply state 00000000c1503ac1 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51a376 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.168279:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51a376 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.168285:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9196889b4800) 00010000:00010000:1.0:1789428194.168288:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789428194.168293:0:22717:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789428194.168348:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a368 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011f8 expref: 15 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.168367:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede51a37d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011f8 expref: 14 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.168375:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:1.0:1789428194.168378:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789428194.168380:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f46c00, rc 0) 00000100:00100000:1.0:1789428194.168517:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+15:18676:x1876350931728000:12345-192.168.202.24@tcp:101:bash.0 Request processed in 16356us (16546us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1789428194.168529:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 37 00000100:00100000:1.0:1789428194.177764:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.177976:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931728256 00000100:00100000:0.0:1789428194.177991:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931728256 00000100:00100000:0.0:1789428194.178072:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:0.0:1789428194.178087:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+15:18676:x1876350931728256:12345-192.168.202.24@tcp:101:bash.0 00010000:00010000:0.0:1789428194.178121:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428194.178153:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a38b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f73011ff expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.178255:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a392 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.178273:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a392 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.178288:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a392 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428194.178356:0:22718:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789428194.178382:0:22718:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789428194.178457:0:22718:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a392 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.178471:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a392 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.178500:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a38b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ff expref: 17 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.178521:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a392 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ff expref: 16 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.178531:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:0.0:1789428194.178534:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789428194.178539:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965c00, rc 0) 00000100:00100000:0.0:1789428194.178626:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+16:18676:x1876350931728256:12345-192.168.202.24@tcp:101:bash.0 Request processed in 544us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428194.178635:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 38 00000100:00100000:3.0:1789428194.181736:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.181814:0:22720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931728512 00000100:00100000:0.0:1789428194.181825:0:22720:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931728512 00000100:00100000:0.0:1789428194.181882:0:22720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:0.0:1789428194.181891:0:22720:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+16:18676:x1876350931728512:12345-192.168.202.24@tcp:35:bash.0 00000100:00100000:0.0:1789428194.182377:0:22720:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+17:18676:x1876350931728512:12345-192.168.202.24@tcp:35:bash.0 Request processed in 483us (649us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1789428194.182386:0:22720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 5 00000100:00100000:3.0:1789428194.275637:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428194.275818:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931728768 00000100:00100000:1.0:1789428194.275831:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931728768 00000100:00100000:1.0:1789428194.275925:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:1.0:1789428194.275938:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+17:18687:x1876350931728768:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:1.0:1789428194.275975:0:24790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428194.276010:0:24790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51a399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301206 expref: -99 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789428194.276195:0:24790:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789428194.276354:0:24790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51a399 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301206 expref: 19 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.276373:0:24790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91969297a000) 00010000:00010000:1.0:1789428194.276378:0:24790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789428194.276385:0:24790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f47400/0x84fc867ede51a399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301206 expref: 19 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.276403:0:24790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47400, rc 0) 00000100:00100000:1.0:1789428194.276560:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+18:18687:x1876350931728768:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 624us (937us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1789428194.276568:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39 00000100:00100000:1.0:1789428194.283597:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.283723:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931729024 00000100:00100000:0.0:1789428194.283738:0:22719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931729024 00000100:00100000:0.0:1789428194.283815:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:0.0:1789428194.283847:0:22719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+18:18687:x1876350931729024:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789428194.284191:0:22719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+19:18687:x1876350931729024:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 346us (611us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1789428194.284201:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 6 00000100:00100000:3.0:1789428194.318680:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.318809:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931729280 00000100:00100000:0.0:1789428194.318823:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931729280 00000100:00100000:0.0:1789428194.318905:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:0.0:1789428194.318920:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+19:18690:x1876350931729280:12345-192.168.202.24@tcp:101:lfs.0 00010000:00010000:0.0:1789428194.318957:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428194.318986:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a3a7 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730120d expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.319135:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a3ae lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.319153:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a3ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.319176:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a3ae lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428194.319191:0:22716:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789428194.319345:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964000/0x84fc867ede51a3a7 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730120d expref: 22 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.319369:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a3ae lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730120d expref: 21 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.319402:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:0.0:1789428194.319405:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789428194.319410:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919699965a00, rc 0) 00000100:00100000:0.0:1789428194.319564:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+21:18690:x1876350931729280:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 646us (898us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1789428194.319572:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 40 00000100:00100000:3.0:1789428194.323162:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428194.323307:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931729408 00000100:00100000:2.0:1789428194.323322:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931729408 00000100:00100000:2.0:1789428194.323411:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:2.0:1789428194.323473:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+21:18690:x1876350931729408:12345-192.168.202.24@tcp:54:lfs.0 00010000:00010000:2.0:1789428194.323574:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a3bc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.323596:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a3bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.323613:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a3bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.323661:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a3bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.323669:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a3bc lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.323675:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a3bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.323707:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed800 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428194.323713:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a3bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.323723:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a3bc lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.323739:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:2.0:1789428194.323742:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789428194.323748:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a3bc lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.323755:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a3bc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428194.323848:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+21:18690:x1876350931729408:12345-192.168.202.24@tcp:54:lfs.0 Request processed in 379us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.323856:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 41 00000100:00100000:3.0:1789428194.330491:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428194.331613:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.331719:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931729792 00000100:00100000:0.0:1789428194.331733:0:22719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931729792 00000100:00100000:0.0:1789428194.331816:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:0.0:1789428194.331829:0:22719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+21:18690:x1876350931729792:12345-192.168.202.24@tcp:35:lfs.0 00000100:00100000:0.0:1789428194.332165:0:22719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+22:18690:x1876350931729792:12345-192.168.202.24@tcp:35:lfs.0 Request processed in 337us (559us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1789428194.332182:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 7 00000100:00100000:1.0:1789428194.337191:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931729536 00000100:00100000:1.0:1789428194.337213:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931729536 00000100:00100000:1.0:1789428194.337453:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:1.0:1789428194.337467:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+22:2396:x1876350931729536:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789428194.337489:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428194.337524:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965a00/0x84fc867ede51a3ae lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730120d expref: 22 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.337553:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:1.0:1789428194.337559:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428194.337739:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+21:2396:x1876350931729536:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 275us (7265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428194.337768:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 10000000:01000000:0.0:1789428194.416584:0:22713:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789428194.416597:0:22713:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919583717800 from 13 10000000:01000000:0.0:1789428194.416604:0:22713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789428194.416672:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699964000/0x84fc867ede51a3c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.416687:0:22713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919699964000/0x84fc867ede51a3c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.416703:0:22713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919699964000/0x84fc867ede51a3c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428194.416740:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940211840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789428194.416869:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.416937:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196adb30300 going to sleep for 11 seconds 00000100:00100000:1.0:1789428194.417094:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940211840 00000100:00100000:1.0:1789428194.417106:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940211840 00000100:00100000:1.0:1789428194.417368:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789428194.417382:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+20:22713:x1876350940211840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789428194.417403:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789428194.417510:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583f47400/0x84fc867ede51a3ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51a3c3 expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.417549:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583f47400/0x84fc867ede51a3ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51a3c3 expref: 21 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.417564:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583f47400/0x84fc867ede51a3ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51a3c3 expref: 21 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.417575:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583f47400, rc 0) 00000100:00100000:1.0:1789428194.417644:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+21:22713:x1876350940211840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 265us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428194.417652:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789428194.417785:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940211840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428194.417806:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919699964000/0x84fc867ede51a3c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a3ca expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.417816:0:22713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919699964000/0x84fc867ede51a3c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51a3ca expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428194.417908:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196b6b65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940211968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428194.417945:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428194.417982:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9840 going to sleep for 11 seconds 00000100:00100000:0.0:1789428194.418067:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940211968 00000100:00100000:0.0:1789428194.418073:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940211968 00000100:00100000:0.0:1789428194.418111:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789428194.418119:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+21:22713:x1876350940211968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428194.420739:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+21:22713:x1876350940211968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2607us (2780us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428194.420758:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789428194.421457:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196b6b65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940211968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428194.421551:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196b6b65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789428194.421636:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428194.421685:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b9840 going to sleep for 11 seconds 00000100:00100000:1.0:1789428194.422688:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940212096 00000100:00100000:1.0:1789428194.422702:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940212096 00000100:00100000:1.0:1789428194.422776:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789428194.422788:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+21:22713:x1876350940212096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789428194.422975:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+21:22713:x1876350940212096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428194.422983:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789428194.423552:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196b6b65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789428194.428024:0:25754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789428194.432824:0:22713:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789428194.432885:0:22713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789428194.432902:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699964000/0x84fc867ede51a3c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a3ca expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.432919:0:22713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919699964000/0x84fc867ede51a3c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a3ca expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428194.432935:0:22713:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789428194.432938:0:22713:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bcc8e800 from 13 10000000:01000000:0.0:1789428194.432941:0:22713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789428194.433004:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede51a3d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.433014:0:22713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede51a3d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.433027:0:22713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede51a3d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428194.433062:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789428194.433195:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.433261:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbb75600 going to sleep for 11 seconds 00000100:00100000:2.0:1789428194.433389:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940212224 00000100:00100000:2.0:1789428194.433401:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940212224 00000100:00100000:2.0:1789428194.433508:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789428194.433519:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+21:22713:x1876350940212224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428194.433536:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428194.433552:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196813ec000/0x84fc867ede51a3d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51a3d1 expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.433581:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813ec000/0x84fc867ede51a3d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51a3d1 expref: 22 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.433593:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196813ec000/0x84fc867ede51a3d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51a3d1 expref: 22 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.433603:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ec000, rc 0) 00000100:00100000:2.0:1789428194.433658:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+22:22713:x1876350940212224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.433665:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789428194.433929:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428194.433946:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede51a3d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a3d8 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.433957:0:22713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede51a3d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51a3d8 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428194.434031:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428194.434060:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.434089:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbb75600 going to sleep for 11 seconds 00000100:00100000:3.0:1789428194.434384:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940212352 00000100:00100000:3.0:1789428194.434391:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940212352 00000100:00100000:3.0:1789428194.434456:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789428194.434466:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+22:22713:x1876350940212352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789428194.434642:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+22:22713:x1876350940212352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.434650:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789428194.435255:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428194.435528:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad92bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789428194.435607:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.435643:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbb75600 going to sleep for 11 seconds 00000100:00100000:3.0:1789428194.435762:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940212480 00000100:00100000:3.0:1789428194.435777:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940212480 00000100:00100000:3.0:1789428194.435826:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789428194.435835:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+22:22713:x1876350940212480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789428194.436000:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+22:22713:x1876350940212480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.436008:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789428194.443589:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad92bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789428194.451773:0:25755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1789428194.452269:0:22713:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1789428194.452316:0:22713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789428194.452331:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede51a3d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a3d8 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.452348:0:22713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919699965a00/0x84fc867ede51a3d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a3d8 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789428194.452362:0:22713:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789428194.452366:0:22713:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff919583218800 from 13 10000000:01000000:0.0:1789428194.452370:0:22713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789428194.452468:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a3df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.452480:0:22713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a3df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.452495:0:22713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a3df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428194.452529:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789428194.452638:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.452692:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff919688908d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789428194.452850:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940212608 00000100:00100000:2.0:1789428194.452861:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940212608 00000100:00100000:2.0:1789428194.453016:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789428194.453029:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196adc6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+22:22713:x1876350940212608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789428194.453047:0:22711:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428194.453063:0:22711:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9196813ed200/0x84fc867ede51a3e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51a3df expref: -99 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.453092:0:22711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9196813ed200/0x84fc867ede51a3e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51a3df expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.453105:0:22711:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9196813ed200/0x84fc867ede51a3e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51a3df expref: 23 pid: 22711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.453114:0:22711:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed200, rc 0) 00000100:00100000:2.0:1789428194.453253:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196adc6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+23:22713:x1876350940212608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 227us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.453262:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789428194.453430:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428194.453447:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a3df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a3e6 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.453457:0:22713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a3df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51a3e6 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428194.453531:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428194.453565:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.461775:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff919688908d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789428194.462133:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940212736 00000100:00100000:2.0:1789428194.462166:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940212736 00000100:00100000:2.0:1789428194.462248:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789428194.462263:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+23:22713:x1876350940212736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789428194.462526:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+23:22713:x1876350940212736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (8960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.462536:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789428194.462681:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428194.462751:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789428194.462819:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.462846:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff919688908d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789428194.468602:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940212864 00000100:00100000:3.0:1789428194.468627:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940212864 00000100:00100000:3.0:1789428194.468720:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789428194.468732:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+23:22713:x1876350940212864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789428194.468989:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+23:22713:x1876350940212864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 259us (6169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.468999:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789428194.469553:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789428194.471410:0:25756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789428194.471825:0:22713:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789428194.471856:0:22713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789428194.471871:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a3df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a3e6 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.471899:0:22713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff919680031000/0x84fc867ede51a3df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a3e6 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789428194.471913:0:22713:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789428194.471917:0:22713:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9196bbbf1000 from 13 10000000:01000000:2.0:1789428194.471920:0:22713:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789428194.471971:0:22713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede51a3ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.471980:0:22713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede51a3ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.471992:0:22713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede51a3ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428194.472024:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196b6b65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789428194.472116:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428194.472181:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196b62b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428194.472372:0:22709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940212992 00000100:00100000:3.0:1789428194.472383:0:22709:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940212992 00000100:00100000:3.0:1789428194.472472:0:22709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789428194.472484:0:22709:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+23:22713:x1876350940212992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789428194.472502:0:22709:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428194.472520:0:22709:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff919583429800/0x84fc867ede51a3f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x84fc867ede51a3ed expref: -99 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.472549:0:22709:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff919583429800/0x84fc867ede51a3f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x84fc867ede51a3ed expref: 24 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.472562:0:22709:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff919583429800/0x84fc867ede51a3f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x84fc867ede51a3ed expref: 24 pid: 22709 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.472573:0:22709:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429800, rc 0) 00000100:00100000:3.0:1789428194.472638:0:22709:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e871a47a-d8aa-4c92-86ef-047b0047c703+24:22713:x1876350940212992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.472645:0:22709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789428194.488437:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196b6b65880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940212992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789428194.488482:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede51a3ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a3f4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.488500:0:22713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede51a3ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x84fc867ede51a3f4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428194.488630:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940213120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428194.488717:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428194.488931:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940213120 00000100:00100000:2.0:1789428194.488940:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940213120 00000100:00100000:2.0:1789428194.488993:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789428194.489004:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+24:22713:x1876350940213120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789428194.491810:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e871a47a-d8aa-4c92-86ef-047b0047c703+24:22713:x1876350940213120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2792us (3077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.491830:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789428194.498611:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff919688908240 going to sleep for 11 seconds 00000100:00100000:0.0:1789428194.498675:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940213120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789428194.498771:0:22713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940213248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789428194.498889:0:22713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.498925:0:22713:0:(client.c:2716:ptlrpc_set_wait()) set ffff919688908240 going to sleep for 11 seconds 00000100:00100000:3.0:1789428194.499057:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940213248 00000100:00100000:3.0:1789428194.499068:0:22711:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940213248 00000100:00100000:3.0:1789428194.499153:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789428194.499172:0:22711:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+24:22713:x1876350940213248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789428194.499339:0:22711:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e871a47a-d8aa-4c92-86ef-047b0047c703+24:22713:x1876350940213248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.499348:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789428194.501670:0:22713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e871a47a-d8aa-4c92-86ef-047b0047c703:22713:1876350940213248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789428194.505090:0:25757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789428194.507325:0:22713:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789428194.507402:0:22713:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.124@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789428194.507466:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede51a3ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a3f4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.507483:0:22713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.124@tcp lock: ffff9196813ece00/0x84fc867ede51a3ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x84fc867ede51a3f4 expref: -99 pid: 22713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428194.608897:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940213376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789428194.609002:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789428194.609127:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940213376 00000100:00100000:0.0:1789428194.609148:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940213376 00000100:00100000:0.0:1789428194.609224:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789428194.609244:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940213376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789428194.609302:0:22721:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789428194.609377:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1876350940213376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428194.609385:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789428194.609596:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196ad928380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3615:1876350940213376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789428194.633092:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.633307:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931730048 00000100:00100000:0.0:1789428194.633322:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931730048 00000100:00100000:0.0:1789428194.633399:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:0.0:1789428194.633411:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+21:18721:x1876350931730048:12345-192.168.202.24@tcp:101:cat.0 00010000:00010000:0.0:1789428194.633485:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428194.633512:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919680031200/0x84fc867ede51a3fb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301214 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.633650:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a402 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.633668:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a402 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.633685:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a402 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428194.633698:0:22716:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789428194.633859:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919680031200/0x84fc867ede51a3fb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301214 expref: 24 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.633883:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a402 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301214 expref: 23 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.633893:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:0.0:1789428194.633896:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789428194.633900:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919680030600, rc 0) 00000100:00100000:0.0:1789428194.633981:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+23:18721:x1876350931730048:12345-192.168.202.24@tcp:101:cat.0 Request processed in 572us (904us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1789428194.634012:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 42 00000100:00100000:2.0:1789428194.639901:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428194.639944:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.640024:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931730304 00000100:00100000:0.0:1789428194.640039:0:22719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931730304 00000100:00100000:0.0:1789428194.640115:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:0.0:1789428194.640127:0:22719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b6b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+23:18721:x1876350931730304:12345-192.168.202.24@tcp:35:cat.0 00000100:00100000:0.0:1789428194.640543:0:22719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b6b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+24:18721:x1876350931730304:12345-192.168.202.24@tcp:35:cat.0 Request processed in 418us (655us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1789428194.640551:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 8 00000100:00100000:3.0:1789428194.641567:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931730432 00000100:00100000:3.0:1789428194.641582:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931730432 00000100:00100000:3.0:1789428194.641654:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:3.0:1789428194.641666:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b6b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+24:2396:x1876350931730432:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789428194.641687:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789428194.641721:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a402 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301214 expref: 24 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.641747:0:22702:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:3.0:1789428194.641753:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428194.641819:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b6b65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+23:2396:x1876350931730432:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 155us (1873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.641846:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:2.0:1789428194.698032:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428194.698168:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931730688 00000100:00100000:3.0:1789428194.698183:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931730688 00000100:00100000:3.0:1789428194.698299:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:3.0:1789428194.698313:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b6b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+23:18727:x1876350931730688:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:3.0:1789428194.698348:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428194.698377:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51a410 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730121b expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.698566:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a417 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.698584:0:22717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede51a37d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011f8 expref: 24 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.698593:0:22717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a392 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ff expref: 24 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.698602:0:22717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a417 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.698651:0:22717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a392 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ff expref: 24 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.698667:0:22717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a392 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ff expref: 24 pid: 22718 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428194.698684:0:22717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22717:1876350940213504:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789428194.698818:0:22717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede51a37d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011f8 expref: 24 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.698829:0:22717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede51a37d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011f8 expref: 24 pid: 22717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428194.698838:0:22717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bff02680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22717:1876350940213632:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789428194.698868:0:22717:0:(client.c:2716:ptlrpc_set_wait()) set ffff919583e21cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789428194.710552:0:22717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff00a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22717:1876350940213504:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789428194.710574:0:22717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bff02680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22717:1876350940213632:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789428194.710608:0:22717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a417 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428194.710735:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428194.710839:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428194.710979:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931730816 00000100:00100000:1.0:1789428194.710990:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931730816 00010000:00010000:1.0:1789428194.711040:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a392 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ff expref: 25 pid: 22718 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428194.711088:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931730944 00000100:00100000:1.0:1789428194.711091:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931730944 00010000:00010000:1.0:1789428194.711105:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede51a37d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011f8 expref: 26 pid: 22717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428194.711478:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:1.0:1789428194.711492:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b6b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+26:2397:x1876350931730816:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789428194.711514:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428194.711523:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a392 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ff expref: 26 pid: 22718 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.711538:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a392 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ff expref: 26 pid: 22718 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.711568:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965c00/0x84fc867ede51a392 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011ff expref: 26 pid: 22718 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.711611:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:1.0:1789428194.711617:0:22701:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a417 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.711628:0:22701:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a417 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.711635:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428194.711710:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b6b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+25:2397:x1876350931730816:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 221us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428194.711718:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17 00000100:00100000:1.0:1789428194.711744:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18 00000100:00100000:1.0:1789428194.711752:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b65de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+24:2397:x1876350931730944:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789428194.711761:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428194.711767:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede51a37d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011f8 expref: 24 pid: 22717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.711777:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede51a37d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011f8 expref: 24 pid: 22717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.711791:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46c00/0x84fc867ede51a37d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f73011f8 expref: 24 pid: 22717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.711802:0:22701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:1.0:1789428194.711806:0:22701:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a417 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.711824:0:22701:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a417 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.711834:0:22701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a417 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428194.711866:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428194.711889:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b65de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+23:2397:x1876350931730944:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 137us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428194.711896:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18 00010000:00010000:0.0:1789428194.712244:0:22717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a417 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.712255:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a417 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428194.712281:0:22717:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789428194.712509:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429a00/0x84fc867ede51a410 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730121b expref: 24 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.712528:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429000/0x84fc867ede51a417 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730121b expref: 23 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.712536:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:0.0:1789428194.712538:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789428194.712541:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429000, rc 0) 00000100:00100000:0.0:1789428194.712584:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b6b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+23:18727:x1876350931730688:12345-192.168.202.24@tcp:101:dd.0 Request processed in 14274us (14568us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1789428194.712593:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 43 00000100:00100000:2.0:1789428194.715067:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.715351:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931731072 00000100:00100000:0.0:1789428194.715365:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931731072 00000100:00100000:0.0:1789428194.718627:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:0.0:1789428194.718662:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b6b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+23:18727:x1876350931731072:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1789428194.718697:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428194.718727:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919680031800/0x84fc867ede51a425 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301222 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.718778:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919680030000/0x84fc867ede51a42c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.718798:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919680030000/0x84fc867ede51a42c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.718814:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919680030000/0x84fc867ede51a42c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.718978:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919680031800/0x84fc867ede51a425 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301222 expref: 25 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.719002:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919680030000/0x84fc867ede51a42c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301222 expref: 24 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.719011:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:0.0:1789428194.719014:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789428194.719019:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919680030000, rc 0) 00000100:00100000:0.0:1789428194.719119:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b6b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+24:18727:x1876350931731072:12345-192.168.202.24@tcp:101:dd.0 Request processed in 476us (4064us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428194.719128:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44 00000100:00100000:0.0:1789428194.722930:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428194.723297:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931731328 00000100:00100000:2.0:1789428194.723312:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931731328 00000100:00100000:2.0:1789428194.723399:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45 00000100:00100000:2.0:1789428194.723624:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+24:18727:x1876350931731328:12345-192.168.202.24@tcp:36:dd.0 00010000:00010000:2.0:1789428194.724028:0:24790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a433 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.724053:0:24790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a433 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.724068:0:24790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a433 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789428194.724122:0:24790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1789428194.724151:0:24790:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003c2b887d reply state 00000000e1329e33 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a433 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.724176:0:24790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a433 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.724184:0:24790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:2.0:1789428194.724188:0:24790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789428194.724193:0:24790:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789428194.724629:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+27:18727:x1876350931731328:12345-192.168.202.24@tcp:36:dd.0 Request processed in 1216us (1711us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1789428194.724639:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45 00000020:00080000:2.0:1789428194.724646:0:24790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789428194.727935:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428194.728013:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931731456 00000100:00100000:2.0:1789428194.728025:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931731456 00000100:00100000:2.0:1789428194.728105:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 46 00000100:00100000:2.0:1789428194.728119:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+27:18727:x1876350931731456:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1789428194.728183:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428194.728213:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a43a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301229 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.728314:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a43a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301229 expref: 28 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.728334:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a43a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301229 expref: 28 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428194.728359:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:2.0:1789428194.728363:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789428194.728367:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed800, rc 0) 00000100:00100000:2.0:1789428194.728830:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+28:18727:x1876350931731456:12345-192.168.202.24@tcp:101:dd.0 Request processed in 712us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428194.728839:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 46 00000040:00080000:2.0:1789428194.737334:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789428194.737814:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428194.744120:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.744312:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931731712 00000100:00100000:0.0:1789428194.744327:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931731712 00000100:00100000:0.0:1789428194.744480:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:0.0:1789428194.744966:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+28:18727:x1876350931731712:12345-192.168.202.24@tcp:103:dd.0 00010000:00010000:0.0:1789428194.744989:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789428194.745020:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed800/0x84fc867ede51a43a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301229 expref: 28 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.745045:0:22703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:0.0:1789428194.745052:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789428194.745119:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+27:18727:x1876350931731712:12345-192.168.202.24@tcp:103:dd.0 Request processed in 628us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428194.745127:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2 00000100:00100000:0.0:1789428194.747576:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428194.747715:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931731840 00000100:00100000:3.0:1789428194.747728:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931731840 00000100:00100000:3.0:1789428194.747802:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:3.0:1789428194.747815:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+27:18727:x1876350931731840:12345-192.168.202.24@tcp:58:dd.0 00010000:00010000:3.0:1789428194.747956:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede51a441 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.747980:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede51a441 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428194.747994:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede51a441 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789428194.751504:0:22717:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789428194.751546:0:22717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:3.0:1789428194.751685:0:22717:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:3.0:1789428194.751892:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad929880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+27:18727:x1876350931731840:12345-192.168.202.24@tcp:58:dd.0 Request processed in 4070us (4319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428194.751907:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 47 00000100:00100000:1.0:1789428194.754334:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428194.754533:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931731968 00000100:00100000:0.0:1789428194.754546:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931731968 00000100:00100000:0.0:1789428194.754661:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:0.0:1789428194.754674:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+27:18727:x1876350931731968:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:0.0:1789428194.754701:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428194.754728:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919680031800/0x84fc867ede51a448 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301230 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.754795:0:22716:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede51a441 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.754806:0:22716:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919680031800/0x84fc867ede51a448 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301230 expref: 28 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.754851:0:22716:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede51a441 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.754866:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919680031800/0x84fc867ede51a448 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301230 expref: 28 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.754882:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:0.0:1789428194.754884:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789428194.754888:0:22716:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919680031800/0x84fc867ede51a448 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301230 expref: 28 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428194.754897:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919680031800, rc 0) 00000100:00100000:0.0:1789428194.754978:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+28:18727:x1876350931731968:12345-192.168.202.24@tcp:101:dd.0 Request processed in 306us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428194.754987:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:3.0:1789428195.127258:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789428195.127291:0:3615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940213760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789428195.127399:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789428195.127821:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940213760 00000100:00100000:1.0:1789428195.127832:0:22722:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940213760 00000100:00100000:1.0:1789428195.127982:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789428195.127995:0:22722:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940213760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789428195.128042:0:22722:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789428195.128824:0:22722:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1876350940213760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 829us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428195.128833:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789428195.131892:0:3615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91958361ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3615:1876350940213760:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1789428195.184775:0:22751:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789428195.184791:0:22751:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789428195.184850:0:22751:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1789428195.184865:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1789428195.185069:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196b6b66680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22751:1876350940213888:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789428195.185480:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbb75600 going to sleep for 11 seconds 00000100:00100000:2.0:1789428195.193501:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196b6b66680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22751:1876350940213888:192.168.202.24@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789428195.199865:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.200186:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931732096 00000100:00100000:2.0:1789428195.200199:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931732096 00000100:00100000:2.0:1789428195.200376:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:2.0:1789428195.200390:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+28:18728:x1876350931732096:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789428195.200462:0:24790:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789428195.200646:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+28:18728:x1876350931732096:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 258us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428195.200655:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00080000:0.0:1789428195.201245:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789428195.224726:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.225021:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931732224 00000100:00100000:2.0:1789428195.225037:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931732224 00000100:00100000:2.0:1789428195.225126:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:2.0:1789428195.225139:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91958361ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+28:18728:x1876350931732224:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789428195.225257:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a44f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225279:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a44f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225295:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a44f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225315:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a456 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225324:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a456 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225331:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a456 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225362:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a45d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225400:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a45d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225407:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a45d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428195.225766:0:22718:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789428195.225773:0:22718:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789428195.225917:0:22718:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a45d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225932:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a44f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225940:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a44f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225948:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a44f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225954:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428195.225959:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a44f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225968:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a44f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.225982:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91969297a200) 00010000:00010000:2.0:1789428195.225986:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428195.225992:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a44f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226013:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a44f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226033:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a456 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226040:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a456 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226047:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a456 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226053:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428195.226056:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a456 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226063:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a456 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226130:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff91969297a900) 00010000:00010000:2.0:1789428195.226133:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428195.226137:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a456 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226143:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a456 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226161:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a45d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226166:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a45d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226179:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a45d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226184:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428195.226187:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a45d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226193:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a45d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226201:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:2.0:1789428195.226204:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428195.226207:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a45d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.226212:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a45d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428195.226392:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91958361ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+28:18728:x1876350931732224:12345-192.168.202.24@tcp:34:lhsmtool_posix.0 Request processed in 1253us (1679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428195.226402:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:1.0:1789428195.234709:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.234951:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931732480 00000100:00100000:2.0:1789428195.234964:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931732480 00000100:00100000:2.0:1789428195.235044:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:2.0:1789428195.235058:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+28:18728:x1876350931732480:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789428195.235090:0:24790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428195.235120:0:24790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a464 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301237 expref: -99 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.235299:0:24790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a46b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.235319:0:24790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a46b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.235334:0:24790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a46b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789428195.235348:0:24790:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789428195.235499:0:24790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a46b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.235506:0:24790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a46b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.235511:0:24790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a46b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.235515:0:24790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428195.235519:0:24790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a46b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.235525:0:24790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a46b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.235536:0:24790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:2.0:1789428195.235539:0:24790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789428195.235543:0:24790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a46b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.235556:0:24790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a46b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.235601:0:24790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a464 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301237 expref: 30 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.235609:0:24790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91969297a200) 00010000:00010000:2.0:1789428195.235610:0:24790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789428195.235613:0:24790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a464 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301237 expref: 30 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.235620:0:24790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ed000, rc 0) 00000100:00100000:2.0:1789428195.235705:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+29:18728:x1876350931732480:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 650us (1011us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1789428195.235713:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:3.0:1789428195.238638:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428195.241056:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931732608 00000100:00100000:0.0:1789428195.241079:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931732608 00000100:00100000:0.0:1789428195.241178:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:0.0:1789428195.241192:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+29:18728:x1876350931732608:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789428195.241259:0:22716:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789428195.241485:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+29:18728:x1876350931732608:12345-192.168.202.24@tcp:53:lhsmtool_posix.0 Request processed in 295us (2860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428195.241494:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 52 00000100:00100000:1.0:1789428195.246003:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.246120:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931732864 00000100:00100000:2.0:1789428195.246134:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931732864 00000100:00100000:2.0:1789428195.246217:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:2.0:1789428195.246238:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+29:18728:x1876350931732864:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789428195.246267:0:24790:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428195.246307:0:24790:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a479 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730123e expref: -99 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789428195.246902:0:24790:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:2.0:1789428195.246910:0:24790:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1789428195.246939:0:24790:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1789428195.247132:0:24790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a480 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.247170:0:24790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a480 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.247187:0:24790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a480 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.247277:0:24790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a479 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730123e expref: 32 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.247302:0:24790:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a480 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730123e expref: 31 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.247310:0:24790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91969297a900) 00010000:00010000:2.0:1789428195.247314:0:24790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789428195.247319:0:24790:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ec600, rc 0) 00000100:00100000:2.0:1789428195.247470:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+31:18728:x1876350931732864:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 1179us (1426us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1789428195.247480:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 53 00000100:00100000:1.0:1789428195.256187:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.256370:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931733120 00000100:00100000:2.0:1789428195.256387:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931733120 00000100:00100000:2.0:1789428195.256514:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:2.0:1789428195.256528:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+31:18728:x1876350931733120:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789428195.256616:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428195.257070:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a480 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730123e expref: 31 pid: 24790 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257100:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91969297a900) 00010000:00010000:2.0:1789428195.257133:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789428195.257166:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a48e lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257186:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a48e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257198:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a48e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257215:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a495 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7e17b56f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257231:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a495 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7e17b56f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257238:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a495 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7e17b56f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257383:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a48e lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257392:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a48e lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257399:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a48e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257407:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ed000 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428195.257526:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a48e lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257537:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a48e lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257556:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9196a235f300) 00010000:00010000:2.0:1789428195.257559:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428195.257565:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a48e lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257571:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ed000/0x84fc867ede51a48e lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257923:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a495 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7e17b56f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257930:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a495 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7e17b56f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257936:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a495 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7e17b56f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257942:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:2.0:1789428195.257945:0:22718:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a495 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7e17b56f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257950:0:22718:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a495 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x7e17b56f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257960:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x7e17b56f (ffff91969297a300) 00010000:00010000:2.0:1789428195.257962:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789428195.257965:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a495 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7e17b56f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.257971:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ecc00/0x84fc867ede51a495 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x7e17b56f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428195.258813:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+30:18728:x1876350931733120:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 2281us (2636us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789428195.258823:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 54 00000100:00100000:0.0:1789428195.274300:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428195.274410:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931733248 00000100:00100000:3.0:1789428195.274469:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931733248 00000100:00100000:3.0:1789428195.274558:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:3.0:1789428195.274573:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+30:18728:x1876350931733248:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789428195.274616:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428195.274646:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429c00/0x84fc867ede51a49c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301245 expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.274698:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428a00/0x84fc867ede51a4a3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.274716:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583428a00/0x84fc867ede51a4a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.274732:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583428a00/0x84fc867ede51a4a3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.274899:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429c00/0x84fc867ede51a49c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301245 expref: 32 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.274922:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428a00/0x84fc867ede51a4a3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301245 expref: 31 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.274933:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91968b029300) 00010000:00010000:3.0:1789428195.274936:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789428195.274941:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583428a00, rc 0) 00000100:00100000:3.0:1789428195.275014:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad928380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+31:18728:x1876350931733248:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 445us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428195.275023:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 55 00000100:00100000:1.0:1789428195.290920:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428195.291189:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931733504 00000100:00100000:0.0:1789428195.291239:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931733504 00000100:00100000:0.0:1789428195.291327:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:0.0:1789428195.291341:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+31:18728:x1876350931733504:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789428195.291640:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a4aa lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.291665:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a4aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.291682:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a4aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789428195.292199:0:22716:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:0.0:1789428195.292213:0:22716:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 539786796635ns, next at 540786793311ns, rc = 0 00000004:00010000:0.0:1789428195.292291:0:22716:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000803b4633 reply state 000000001acca4bd transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a4aa lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.292308:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a4aa lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.292319:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91968b029300) 00010000:00010000:0.0:1789428195.292322:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789428195.292327:0:22716:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789428195.292587:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+33:18728:x1876350931733504:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 1233us (1667us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1789428195.292597:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 56 00000100:00100000:0.0:1789428195.303897:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428195.304348:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931733632 00000100:00100000:3.0:1789428195.304366:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931733632 00000100:00100000:3.0:1789428195.304502:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:3.0:1789428195.304516:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196ad92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+33:18728:x1876350931733632:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789428195.304561:0:22717:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789428195.304591:0:22717:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583429c00/0x84fc867ede51a4b1 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730124c expref: -99 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.304678:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583429c00/0x84fc867ede51a4b1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730124c expref: 34 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.304695:0:22717:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429c00/0x84fc867ede51a4b1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730124c expref: 34 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.304747:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91968b029300) 00010000:00010000:3.0:1789428195.304751:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789428195.304756:0:22717:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919583429c00, rc 0) 00000100:00100000:3.0:1789428195.304843:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196ad92bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+34:18728:x1876350931733632:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 330us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428195.304850:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 57 00000100:00100000:3.0:1789428195.308664:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.308762:0:24222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931733760 00000100:00100000:2.0:1789428195.308776:0:24222:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931733760 00000100:00100000:2.0:1789428195.308884:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:2.0:1789428195.308897:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2396:x1876350931733760:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789428195.309263:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:2396:x1876350931733760:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 368us (615us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1789428195.309272:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00080000:0.0:1789428195.310063:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789428195.314481:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428195.314891:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931734016 00000100:00100000:1.0:1789428195.314908:0:22719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931734016 00000100:00100000:1.0:1789428195.314996:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:1.0:1789428195.315011:0:22719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+34:18728:x1876350931734016:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789428195.315392:0:22719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+35:18728:x1876350931734016:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 383us (926us total) trans 12884901910 rc 0/0 00000100:00100000:1.0:1789428195.315401:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 9 00000100:00100000:1.0:1789428195.319484:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.321111:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931734272 00000100:00100000:2.0:1789428195.321132:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931734272 00000100:00100000:2.0:1789428195.321456:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:2.0:1789428195.321470:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+35:18728:x1876350931734272:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789428195.321679:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+35:18728:x1876350931734272:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 212us (2208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428195.321688:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 58 00000100:00100000:3.0:1789428195.324101:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428195.325658:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931734400 00000100:00100000:0.0:1789428195.325699:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931734400 00000100:00100000:0.0:1789428195.325791:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:0.0:1789428195.325804:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+35:18728:x1876350931734400:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789428195.325833:0:22716:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789428195.325862:0:22716:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919680030800/0x84fc867ede51a4b8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301253 expref: -99 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.325960:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff919680031200/0x84fc867ede51a4bf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.325978:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919680031200/0x84fc867ede51a4bf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.325992:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919680031200/0x84fc867ede51a4bf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789428195.326053:0:22716:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789428195.326080:0:22716:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff919680031200/0x84fc867ede51a4bf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.326114:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919680030800/0x84fc867ede51a4b8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301253 expref: 37 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.326349:0:22716:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff919680031200/0x84fc867ede51a4bf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301253 expref: 36 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.326362:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91968b029300) 00010000:00010000:0.0:1789428195.326366:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789428195.326370:0:22716:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff919680031200, rc 0) 00000100:00100000:0.0:1789428195.326503:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+36:18728:x1876350931734400:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 701us (2416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428195.326522:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 59 00000100:00100000:1.0:1789428195.329957:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.330069:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931734528 00000100:00100000:2.0:1789428195.330083:0:25188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931734528 00000100:00100000:2.0:1789428195.330263:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:2.0:1789428195.330286:0:25188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:2396:x1876350931734528:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789428195.330313:0:25188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428195.330343:0:25188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a4c6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f730125a expref: -99 pid: 25188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789428195.330406:0:25188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa881e2, blocks: 0x0 00010000:00010000:2.0:1789428195.330466:0:25188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1789428195.330472:0:25188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428195.330484:0:25188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a4c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730125a expref: 7 pid: 25188 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.330510:0:25188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a4c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730125a expref: 7 pid: 25188 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.330526:0:25188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ecc00, rc 0) 00000100:00100000:2.0:1789428195.330647:0:25188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:2396:x1876350931734528:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 373us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428195.330657:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:0.0:1789428195.337393:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428195.337641:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931734784 00000100:00100000:1.0:1789428195.337656:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931734784 00000100:00100000:1.0:1789428195.337735:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:1.0:1789428195.337748:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+36:18728:x1876350931734784:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789428195.337909:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+36:18728:x1876350931734784:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 162us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428195.337919:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 60 00000100:00100000:3.0:1789428195.340184:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.340819:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931734912 00000100:00100000:2.0:1789428195.340833:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931734912 00000100:00100000:2.0:1789428195.340937:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 61 00000100:00100000:2.0:1789428195.340951:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bff03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+36:18728:x1876350931734912:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789428195.347078:0:22696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:2.0:1789428195.347110:0:22696:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789428195.347176:0:22696:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1789428195.347249:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a2b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347265:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a2b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347274:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a2b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347282:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699964400 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428195.347288:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a2b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347298:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a2b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347319:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff9196a235fe00) 00010000:00010000:0.0:1789428195.347323:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428195.347330:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a2b9 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347337:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699964400/0x84fc867ede51a2b9 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347370:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2c0 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347377:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2c0 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347400:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2c0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347407:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919699965800 already unused, calling callback (ffffffffc179f4f0) 00000100:00100000:2.0:1789428195.347442:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bff03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+19:18728:x1876350931734912:12345-192.168.202.24@tcp:44:lhsmtool_posix.0 Request processed in 6456us (7231us total) trans 0 rc 0/0 00010000:00010000:0.0:1789428195.347455:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2c0 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428195.347457:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 61 00010000:00010000:0.0:1789428195.347469:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2c0 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347480:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9196a235f300) 00010000:00010000:0.0:1789428195.347484:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428195.347487:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2c0 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347494:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919699965800/0x84fc867ede51a2c0 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347514:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51a376 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347521:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51a376 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347528:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51a376 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347533:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583f46600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428195.347536:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51a376 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347554:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51a376 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347565:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff9196889b4800) 00010000:00010000:0.0:1789428195.347568:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428195.347571:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51a376 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347577:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46600/0x84fc867ede51a376 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347595:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a433 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347603:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a433 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347609:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a433 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347615:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813eda00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428195.347618:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a433 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347624:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a433 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347634:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:0.0:1789428195.347636:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789428195.347650:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a433 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.347663:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a433 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.348008:0:3599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a4aa lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.348017:0:3599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a4aa lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.348024:0:3599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a4aa lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.348029:0:3599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919680030600 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:0.0:1789428195.348032:0:3599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a4aa lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.348038:0:3599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a4aa lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.348049:0:3599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91968b029300) 00010000:00010000:0.0:1789428195.348051:0:3599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789428195.348055:0:3599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a4aa lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789428195.348061:0:3599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919680030600/0x84fc867ede51a4aa lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789428195.348462:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789428195.348485:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940214016:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789428195.348569:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789428195.348630:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a30d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.348643:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a30d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.348659:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a30d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.348666:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ede00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:1.0:1789428195.348670:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a30d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.348677:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a30d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.348702:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff9196a235f300) 00010000:00010000:1.0:1789428195.348705:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789428195.348713:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a30d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.348720:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a30d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428195.348750:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940214016 00000100:00100000:3.0:1789428195.348760:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940214016 00000100:00100000:3.0:1789428195.348818:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789428195.348829:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940214016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789428195.348999:0:24220:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789428195.349004:0:24220:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789428195.349006:0:24220:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789428195.349008:0:24220:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789428194 -> 1789428194 00002000:00010000:3.0:1789428195.349011:0:24220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000004:00080000:1.0:1789428195.349558:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff919583ffaa00/2, rc 0, transno 12884901892 00000100:00100000:1.0:1789428195.349571:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ffaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940214016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789428195.349634:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1876350940214016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 805us (1065us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1789428195.349655:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789428195.349814:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428195.349923:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931735040 00000100:00100000:3.0:1789428195.349930:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931735040 00000100:00100000:3.0:1789428195.350042:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:3.0:1789428195.350052:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b0a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:2397:x1876350931735040:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789428195.350162:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b0a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:2397:x1876350931735040:12345-192.168.202.24@tcp:16:lhsmtool_posix.0 Request processed in 111us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428195.350170:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24 00000100:00100000:2.0:1789428195.352287:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428195.352489:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931735296 00000100:00100000:1.0:1789428195.352501:0:22716:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931735296 00000100:00100000:1.0:1789428195.352664:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:1.0:1789428195.352678:0:22716:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b6b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+15:18728:x1876350931735296:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789428195.352754:0:22716:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428195.352792:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919680031200/0x84fc867ede51a4bf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301253 expref: 15 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.352817:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91968b029300) 00010000:00010000:1.0:1789428195.352824:0:22716:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789428195.352985:0:22716:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede51a4cd lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.353003:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede51a4cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.353015:0:22716:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede51a4cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789428195.353196:0:22716:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e926121e reply state 0000000041de2601 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede51a4cd lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.353210:0:22716:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583f46400/0x84fc867ede51a4cd lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22716 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.353217:0:22716:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91968b029300) 00010000:00010000:1.0:1789428195.353228:0:22716:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789428195.353232:0:22716:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789428195.353365:0:22716:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b6b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+16:18728:x1876350931735296:12345-192.168.202.24@tcp:36:lhsmtool_posix.0 Request processed in 689us (1092us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1789428195.353374:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 62 00000100:00100000:0.0:1789428195.356494:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.357396:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931735424 00000100:00100000:2.0:1789428195.357412:0:25188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931735424 00000100:00100000:2.0:1789428195.357525:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:2.0:1789428195.357539:0:25188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:18728:x1876350931735424:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789428195.357565:0:25188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428195.357597:0:25188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a4d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301261 expref: -99 pid: 25188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.357639:0:25188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a4c6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730125a expref: 8 pid: 25188 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.357742:0:25188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428195.357749:0:25188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428195.357756:0:25188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a4d4 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301261 expref: 8 pid: 25188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.357808:0:25188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a4c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730125a expref: 8 pid: 25188 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.357826:0:25188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a4c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730125a expref: 8 pid: 25188 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428195.358322:0:25188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196b6b67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25188:1876350940214144:192.168.202.24@tcp:104: 00000100:00100000:2.0:1789428195.358527:0:25188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196bbb75600 going to sleep for 11 seconds 00000100:00100000:0.0:1789428195.361136:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.361217:0:25188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196b6b67b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:25188:1876350940214144:192.168.202.24@tcp:104: 00010000:00010000:2.0:1789428195.361277:0:25188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a4d4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301261 expref: 8 pid: 25188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.361324:0:25188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813ec600, rc 0) 00000100:00100000:2.0:1789428195.361392:0:25188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+8:18728:x1876350931735424:12345-192.168.202.24@tcp:101:lhsmtool_posix.0 Request processed in 3856us (4912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428195.361402:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25 00000100:00100000:1.0:1789428195.361539:0:22701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931735552 00000100:00100000:1.0:1789428195.361548:0:22701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931735552 00010000:00010000:1.0:1789428195.361586:0:22701:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a4c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730125a expref: 8 pid: 25188 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428195.361626:0:22701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:1.0:1789428195.361637:0:22701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+8:2397:x1876350931735552:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789428195.361663:0:22701:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428195.361690:0:22701:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a4c6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730125a expref: 8 pid: 25188 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.361706:0:22701:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a4c6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730125a expref: 8 pid: 25188 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.361751:0:22701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a4c6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730125a expref: 8 pid: 25188 timeout: 639 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.361768:0:22701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428195.361772:0:22701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789428195.361779:0:22701:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a4d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301261 expref: 7 pid: 25188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.361792:0:22701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a4d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301261 expref: 7 pid: 25188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.361843:0:22701:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a4d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301261 expref: 7 pid: 25188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428195.361861:0:22701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9196bf9f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22701:1876350940214272:192.168.202.24@tcp:105: 00000100:00100000:1.0:1789428195.361931:0:22701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196a05e5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789428195.366163:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428195.366245:0:24220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931735680 00000100:00100000:3.0:1789428195.366258:0:24220:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931735680 00000100:00100000:1.0:1789428195.366292:0:22701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9196bf9f8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22701:1876350940214272:192.168.202.24@tcp:105: 00010000:00010000:1.0:1789428195.366327:0:22701:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789428195.366344:0:24220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:3.0:1789428195.366363:0:24220:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+8:2396:x1876350931735680:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789428195.366408:0:22701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+8:2397:x1876350931735552:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 4773us (5287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428195.366442:0:22701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00002000:00010000:3.0:1789428195.366592:0:24220:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789428195.366596:0:24220:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789428194 00002000:00010000:3.0:1789428195.366599:0:24220:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789428193 00002000:00010000:3.0:1789428195.366600:0:24220:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789428194 -> 1789428194 00002000:00010000:3.0:1789428195.366602:0:24220:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1789428195.366627:0:24220:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+8:2396:x1876350931735680:12345-192.168.202.24@tcp:2:lhsmtool_posix.0 Request processed in 274us (479us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1789428195.366632:0:24220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26 00000100:00100000:0.0:1789428195.369568:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428195.369764:0:24221:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931735808 00000100:00100000:3.0:1789428195.369777:0:24221:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931735808 00000100:00100000:3.0:1789428195.369856:0:24221:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:3.0:1789428195.369869:0:24221:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+8:2394:x1876350931735808:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789428195.369926:0:24221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.369946:0:24221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a4d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301261 expref: 8 pid: 25188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.369973:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789428195.369978:0:24221:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789428195.369981:0:24221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.370021:0:24221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a4d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301261 expref: 8 pid: 25188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.370034:0:24221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a4d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301261 expref: 8 pid: 25188 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428195.370048:0:24221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24221:1876350940214400:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789428195.370143:0:24221:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789428195.373192:0:3606:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428195.373574:0:24221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:24221:1876350940214400:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789428195.373608:0:24221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428195.373700:0:22702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931735936 00000100:00100000:1.0:1789428195.373709:0:22702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931735936 00010000:00010000:1.0:1789428195.373762:0:22702:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a4d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301261 expref: 9 pid: 25188 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428195.373829:0:22702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:1.0:1789428195.373840:0:22702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196b6b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+9:2396:x1876350931735936:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789428195.373860:0:22702:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789428195.373888:0:22702:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a4d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301261 expref: 9 pid: 25188 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.373901:0:22702:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a4d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301261 expref: 9 pid: 25188 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.373931:0:22702:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a4d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301261 expref: 9 pid: 25188 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.373955:0:22702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789428195.373960:0:22702:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789428195.373966:0:22702:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.373977:0:22702:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.374012:0:22702:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789428195.374088:0:22702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196b6b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+8:2396:x1876350931735936:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 249us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428195.374096:0:22702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00010000:00010000:3.0:1789428195.374457:0:24221:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.374469:0:24221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.374495:0:24221:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.374513:0:24221:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.374521:0:24221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.374528:0:24221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583429a00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:3.0:1789428195.374533:0:24221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.374543:0:24221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.374557:0:24221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.374565:0:24221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000029551ae/0x84fc867ede51a4db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428195.374628:0:24221:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+7:2394:x1876350931735808:12345-192.168.202.24@tcp:1:lhsmtool_posix.0 Request processed in 4760us (5075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428195.374638:0:24221:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 27 00000100:00100000:1.0:1789428195.378859:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428195.378972:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931736192 00000100:00100000:3.0:1789428195.378987:0:22717:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931736192 00000100:00100000:3.0:1789428195.379068:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 63 00000100:00100000:3.0:1789428195.379100:0:22717:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+16:18728:x1876350931736192:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789428195.379239:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.379262:0:22717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919680030000/0x84fc867ede51a42c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301222 expref: 16 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.379274:0:22717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.379319:0:22717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919680030000/0x84fc867ede51a42c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301222 expref: 16 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.379335:0:22717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919680030000/0x84fc867ede51a42c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301222 expref: 16 pid: 22716 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428195.379355:0:22717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22717:1876350940214528:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789428195.380864:0:22717:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87d540 going to sleep for 11 seconds 00000100:00100000:1.0:1789428195.389538:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428195.389692:0:22717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22717:1876350940214528:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789428195.389729:0:22717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428195.390333:0:25741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931736320 00000100:00100000:2.0:1789428195.390345:0:25741:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931736320 00010000:00010000:2.0:1789428195.390400:0:25741:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919680030000/0x84fc867ede51a42c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301222 expref: 17 pid: 22716 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428195.390493:0:25741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:2.0:1789428195.390504:0:25741:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+17:2396:x1876350931736320:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789428195.390525:0:25741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428195.390533:0:25741:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919680030000/0x84fc867ede51a42c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301222 expref: 17 pid: 22716 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.390548:0:25741:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919680030000/0x84fc867ede51a42c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301222 expref: 17 pid: 22716 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.390575:0:25741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919680030000/0x84fc867ede51a42c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f7301222 expref: 17 pid: 22716 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.390596:0:25741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:2.0:1789428195.390603:0:25741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919680031800/0x84fc867ede51a448 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301230 expref: 16 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.390647:0:25741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.390658:0:25741:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.390667:0:25741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.390698:0:25741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428195.390766:0:25741:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+16:2396:x1876350931736320:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 264us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428195.390774:0:25741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00010000:00010000:3.0:1789428195.390895:0:22717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.390905:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.391189:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.391210:0:22717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429c00/0x84fc867ede51a4b1 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f730124c expref: 16 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.391228:0:22717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.391265:0:22717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff919583429c00/0x84fc867ede51a4b1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730124c expref: 16 pid: 22717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.391282:0:22717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff919583429c00/0x84fc867ede51a4b1 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730124c expref: 16 pid: 22717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428195.391297:0:22717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22717:1876350940214656:192.168.202.24@tcp:104: 00000100:00100000:3.0:1789428195.391361:0:22717:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87dc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789428195.398113:0:22717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22717:1876350940214656:192.168.202.24@tcp:104: 00010000:00010000:3.0:1789428195.398174:0:22717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789428195.399596:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.399843:0:22703:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931736448 00000100:00100000:2.0:1789428195.399858:0:22703:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931736448 00010000:00010000:2.0:1789428195.399916:0:22703:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583429c00/0x84fc867ede51a4b1 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730124c expref: 17 pid: 22717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428195.399970:0:22703:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:2.0:1789428195.399981:0:22703:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+17:2397:x1876350931736448:12345-192.168.202.24@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789428195.400003:0:22703:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789428195.400012:0:22703:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff919583429c00/0x84fc867ede51a4b1 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730124c expref: 17 pid: 22717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.400027:0:22703:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff919583429c00/0x84fc867ede51a4b1 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730124c expref: 17 pid: 22717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.400082:0:22703:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583429c00/0x84fc867ede51a4b1 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.24@tcp remote: 0x1f632749f730124c expref: 17 pid: 22717 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.400102:0:22703:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91968b029300) 00010000:00010000:2.0:1789428195.400109:0:22703:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.400122:0:22703:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.400131:0:22703:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.400187:0:22703:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789428195.400286:0:22703:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+16:2397:x1876350931736448:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 305us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428195.400295:0:22703:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00010000:00010000:3.0:1789428195.401082:0:22717:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.401094:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789428195.401303:0:22717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1789428195.401520:0:22717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1789428195.401562:0:22717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1789428195.401806:0:22717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22717:1876350940214784:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789428195.401906:0:22717:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428195.402007:0:22717:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789428195.403093:0:23457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940214784 00000100:00100000:1.0:1789428195.403108:0:23457:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940214784 00000100:00100000:1.0:1789428195.403409:0:23457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789428195.403450:0:23457:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22717:x1876350940214784:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789428195.403673:0:23457:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22717:x1876350940214784:12345-0@lo:1000:mdt00_001.0 Request processed in 227us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428195.403682:0:23457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789428195.403806:0:22717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22717:1876350940214784:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789428195.404057:0:22717:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:3.0:1789428195.404182:0:22717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22717:1876350940214912:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789428195.404235:0:22717:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789428195.405195:0:22717:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789428195.405506:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940214912 00000100:00100000:0.0:1789428195.405518:0:22721:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940214912 00000100:00100000:0.0:1789428195.405581:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789428195.405592:0:22721:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22717:x1876350940214912:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789428195.405840:0:22721:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22717:x1876350940214912:12345-0@lo:1000:mdt00_001.0 Request processed in 249us (1603us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1789428195.405847:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789428195.406002:0:22717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ff8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22717:1876350940214912:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789428195.406061:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406074:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406083:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406089:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fe00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789428195.406095:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406104:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406123:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91968b029300) 00010000:00010000:3.0:1789428195.406126:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789428195.406131:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406149:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fe00/0x84fc867ede51a4e9 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406218:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede51a441 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406234:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede51a441 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406241:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede51a441 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406246:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583428200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789428195.406249:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede51a441 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406255:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede51a441 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406263:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:3.0:1789428195.406266:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789428195.406275:0:22717:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff919680031800/0x84fc867ede51a448 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301230 expref: 19 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406297:0:22717:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff919680031800/0x84fc867ede51a448 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301230 expref: 19 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406309:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919680031800/0x84fc867ede51a448 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301230 expref: 19 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.406380:0:22717:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff919680031800/0x84fc867ede51a448 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301230 expref: 19 pid: 22716 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428195.406409:0:22717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583ffad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22717:1876350940215040:192.168.202.24@tcp:105: 00000100:00100000:3.0:1789428195.406552:0:22717:0:(client.c:2716:ptlrpc_set_wait()) set ffff9196ae87d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789428195.411164:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:3.0:1789428195.411661:0:22717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583ffad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22717:1876350940215040:192.168.202.24@tcp:105: 00010000:00010000:3.0:1789428195.411697:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede51a441 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411711:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583428200/0x84fc867ede51a441 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411755:0:22717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51a4f0 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411773:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51a4f0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411786:0:22717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51a4f0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411799:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51a4f0 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411805:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51a4f0 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411812:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51a4f0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411818:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1e200 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789428195.411823:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51a4f0 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411848:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51a4f0 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411863:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:3.0:1789428195.411866:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789428195.411871:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51a4f0 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411876:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1e200/0x84fc867ede51a4f0 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411887:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411892:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411898:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411902:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff919583d1fc00 already unused, calling callback (ffffffffc179f4f0) 00010000:00010000:3.0:1789428195.411905:0:22717:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411911:0:22717:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411917:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:3.0:1789428195.411920:0:22717:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789428195.411922:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789428195.411941:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff919583d1fc00/0x84fc867ede51a4e2 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22717 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789428195.412169:0:22717:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+19:18728:x1876350931736192:12345-192.168.202.24@tcp:57:lhsmtool_posix.0 Request processed in 33070us (33326us total) trans 12884901916 rc 0/0 00000100:00100000:3.0:1789428195.412181:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 63 00000020:00080000:3.0:1789428195.412194:0:22717:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789428195.413129:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931736576 00000100:00100000:2.0:1789428195.413146:0:22719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931736576 00000100:00100000:2.0:1789428195.413260:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 10 00000100:00100000:2.0:1789428195.413272:0:22719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bcc09050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+19:18727:x1876350931736576:12345-192.168.202.24@tcp:49:dd.0 00000100:00100000:2.0:1789428195.413471:0:22719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bcc09050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+19:18727:x1876350931736576:12345-192.168.202.24@tcp:49:dd.0 Request processed in 201us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428195.413480:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 10 00000040:00080000:1.0:1789428195.416824:0:22751:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789428195.416838:0:22751:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789428195.416878:0:22751:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789428195.416889:0:22751:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1789428195.418536:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428195.418580:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.418688:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931736832 00000100:00100000:2.0:1789428195.418701:0:22719:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931736832 00000100:00100000:2.0:1789428195.418777:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 11 00000100:00100000:2.0:1789428195.418806:0:22719:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+19:18728:x1876350931736832:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789428195.419204:0:22719:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789428195.419263:0:22719:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1789428195.419320:0:22719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a4f7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.419343:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a4f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.419357:0:22719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a4f7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.419368:0:22719:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a4f7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.419374:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a4f7 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.419381:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a4f7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.419402:0:22719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789428195.419551:0:22719:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+21:18728:x1876350931736832:12345-192.168.202.24@tcp:35:lhsmtool_posix.0 Request processed in 746us (1024us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1789428195.419560:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 11 00000020:00080000:2.0:1789428195.419567:0:22719:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789428195.419942:0:23475:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789428195.419952:0:23475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a4f7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.419962:0:23475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ede00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:1.0:1789428195.419967:0:23475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a4f7 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.419977:0:23475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a4f7 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.419994:0:23475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91968b029300) 00010000:00010000:1.0:1789428195.420011:0:23475:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789428195.420019:0:23475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a4f7 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.420026:0:23475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ede00/0x84fc867ede51a4f7 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22719 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789428195.420044:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428195.420046:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789428195.420048:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789428195.422455:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931736960 00000100:00100000:2.0:1789428195.422481:0:22718:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931736960 00000100:00100000:2.0:1789428195.422575:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:2.0:1789428195.422589:0:22718:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+21:18727:x1876350931736960:12345-192.168.202.24@tcp:101:dd.0 00010000:00010000:2.0:1789428195.422696:0:22718:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789428195.422727:0:22718:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a4fe lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1f632749f7301268 expref: -99 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.422773:0:22718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a505 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.422793:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a505 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.422808:0:22718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a505 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22718 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.422951:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9196813ec600/0x84fc867ede51a4fe lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301268 expref: 23 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.422977:0:22718:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9196813eda00/0x84fc867ede51a505 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x1f632749f7301268 expref: 22 pid: 22718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.422986:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff9196889b4300) 00010000:00010000:2.0:1789428195.422989:0:22718:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789428195.422994:0:22718:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9196813eda00, rc 0) 00000100:00100000:2.0:1789428195.423091:0:22718:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+22:18727:x1876350931736960:12345-192.168.202.24@tcp:101:dd.0 Request processed in 504us (4508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428195.423099:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 64 00000100:00100000:1.0:1789428195.454250:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428195.454313:0:3607:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:2.0:1789428195.454486:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931737216 00000100:00100000:2.0:1789428195.454501:0:24227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931737216 00000100:00100000:2.0:1789428195.454589:0:24227:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931737088 00000100:00100000:2.0:1789428195.454593:0:24227:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931737088 00000100:00100000:2.0:1789428195.454642:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:2.0:1789428195.454653:0:24227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bf9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+8:2396:x1876350931737216:12345-192.168.202.24@tcp:4:dd.0 00002000:00010000:2.0:1789428195.454718:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa881e2, atime: 0x6aa881e1, ctime: 0x6aa881e2, blocks: 0x0 00010000:00010000:2.0:1789428195.454730:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a50c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.454751:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=539s v=(0 0) 00010000:00010000:2.0:1789428195.454758:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428195.454765:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a50c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.454784:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a50c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789428195.534349:0:25035:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:0.0:1789428195.534380:0:25035:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1789428195.534629:0:24227:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1789428195.534636:0:24227:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1789428195.534721:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a50c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.534738:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a50c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.534749:0:24227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a50c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.534757:0:24227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ec600 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428195.534763:0:24227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a50c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.534795:0:24227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a50c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.534823:0:24227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a50c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.534832:0:24227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001021c510/0x84fc867ede51a50c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428195.535045:0:24227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bf9f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+6:2396:x1876350931737216:12345-192.168.202.24@tcp:4:dd.0 Request processed in 80386us (80833us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789428195.535059:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 0 00000100:00100000:2.0:1789428195.535111:0:24227:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 1 00000100:00100000:2.0:1789428195.535124:0:24227:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9196bca2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2396:x1876350931737088:12345-192.168.202.24@tcp:4:dd.0 00002000:00010000:2.0:1789428195.535175:0:24227:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 7654321, mtime: 0x6aa881e2, atime: 0x6aa881e1, ctime: 0x6aa881e2, blocks: 0x1a68 00010000:00010000:2.0:1789428195.535182:0:24227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a513 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.535196:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=540s v=(0 0) 00010000:00010000:2.0:1789428195.535201:0:24227:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789428195.535208:0:24227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.535235:0:24227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789428195.631099:0:25035:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:2.0:1789428195.631687:0:24227:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:2.0:1789428195.631714:0:24227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a513 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.631732:0:24227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a513 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.631743:0:24227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a513 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.631750:0:24227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9196813ecc00 already unused, calling callback (ffffffffc0b8d8b0) 00010000:00010000:2.0:1789428195.631756:0:24227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a513 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.631765:0:24227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a513 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.631790:0:24227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a513 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789428195.631798:0:24227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bea868ff/0x84fc867ede51a513 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789428195.631988:0:24227:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9196bca2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2396:x1876350931737088:12345-192.168.202.24@tcp:4:dd.0 Request processed in 96859us (177665us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1789428195.632002:0:24227:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 1 00000040:00080000:2.0:1789428195.761340:0:23473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789428195.764106:0:22705:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789428196.793683:0:22704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789428196.836719:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428196.836768:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428196.836823:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428196.836849:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931737600 00000100:00100000:0.0:1789428196.836850:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428196.836865:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931737600 00000100:00100000:0.0:1789428196.836870:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428196.836889:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428196.836908:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428196.836929:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:0.0:1789428196.836955:0:3608:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp) 00000100:00100000:1.0:1789428196.836957:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931738112 00000100:00100000:1.0:1789428196.836963:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931738112 00000100:00100000:0.0:1789428196.836983:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931737856 00000100:00100000:1.0:1789428196.836988:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931737472 00000100:00100000:0.0:1789428196.836990:0:25188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931737856 00000100:00100000:1.0:1789428196.836994:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931737472 00000100:00100000:1.0:1789428196.837021:0:24790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931737984 00000100:00100000:1.0:1789428196.837024:0:24790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931737984 00000100:00100000:0.0:1789428196.837032:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931738368 00000100:00100000:0.0:1789428196.837037:0:25188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931738368 00000100:00100000:0.0:1789428196.837052:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931737728 00000100:00100000:0.0:1789428196.837062:0:25188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931737728 00000100:00100000:0.0:1789428196.837089:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931738240 00000100:00100000:0.0:1789428196.837091:0:25188:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931738240 00000100:00100000:0.0:1789428196.837112:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:0.0:1789428196.837126:0:25188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2397:x1876350931737856:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789428196.837128:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:1.0:1789428196.837142:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2397:x1876350931737600:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789428196.837494:0:25188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2397:x1876350931737856:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 372us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428196.837503:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19 00000100:00100000:0.0:1789428196.837524:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:0.0:1789428196.837532:0:25188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+5:2397:x1876350931738368:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:2.0:1789428196.838163:0:24222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:2.0:1789428196.838177:0:24222:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2397:x1876350931737728:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:3.0:1789428196.838308:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350931737344 00000100:00100000:3.0:1789428196.838318:0:22710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350931737344 00000100:00100000:3.0:1789428196.838358:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 161 00000100:00100000:3.0:1789428196.838365:0:22710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff91968896a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:2397:x1876350931737344:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789428196.842003:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2397:x1876350931737600:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 4843us (5211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428196.842024:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48 00000100:00100000:1.0:1789428196.842304:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:1.0:1789428196.842327:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+5:2397:x1876350931738112:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789428196.842507:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+5:2397:x1876350931738112:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 192us (5656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428196.842542:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49 00000100:00100000:1.0:1789428196.842560:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:1.0:1789428196.842569:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+22:2397:x1876350931737472:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789428196.842609:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+22:2397:x1876350931737472:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 41us (5718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428196.842615:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 50 00000100:00100000:1.0:1789428196.842868:0:24790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00100000:1.0:1789428196.842878:0:24790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:2397:x1876350931737984:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:1.0:1789428196.842916:0:24790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+6:2397:x1876350931737984:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 39us (5987us total) trans 0 rc 0/0 00000100:00100000:1.0:1789428196.842922:0:24790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 51 00000100:00080000:1.0:1789428196.842967:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789428196.842975:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789428196.842979:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789428196.842983:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789428196.844021:0:25188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+5:2397:x1876350931738368:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 6478us (7138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428196.844039:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20 00000100:00100000:0.0:1789428196.844092:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:0.0:1789428196.844115:0:25188:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+5:2397:x1876350931738240:12345-192.168.202.24@tcp:400:kworker.0 00000100:00100000:0.0:1789428196.844165:0:25188:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6def47a4-6189-4bdd-97b7-d460dc95e7fc+5:2397:x1876350931738240:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 64us (7210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789428196.844171:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22 00000100:00100000:2.0:1789428196.846510:0:24222:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0304e1d9-31ca-4d6f-ad12-f6b219f360cb+5:2397:x1876350931737728:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 8323us (9585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789428196.846527:0:24222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21 00000100:00100000:3.0:1789428196.847407:0:22710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff91968896a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e26acd45-ce12-4c56-8027-8ae3c1aab989+13:2397:x1876350931737344:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 9034us (10698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428196.847941:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 161 00000001:02000400:3.0:1789428197.260125:0:25795:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1789428197.809233:0:23475:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789428198.193222:0:3614:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff919583fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940215168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789428198.193337:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789428198.193566:0:24223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876350940215168 00000100:00100000:2.0:1789428198.193578:0:24223:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876350940215168 00000100:00100000:2.0:1789428198.193671:0:24223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789428198.193682:0:22712:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789428198.193684:0:24223:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff919583ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940215168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789428198.193724:0:24223:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1789428198.198978:0:24223:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff919583ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1876350940215168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5281us (5626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789428198.198995:0:3614:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff919583fc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3614:1876350940215168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789428198.198999:0:24223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 Debug log: 13441 lines, 13441 kept, 0 dropped, 0 bad.